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ABSTPACT 

This is a comprehensive report of the effects of 
-local school programs, K-12, developed irith fun^ froi ESEA Title I, 
the State Educationally Disad vai^taged Youth (EDT) Act, and the E^rly 
Childliood Education (ECE) refori effort during 197<I*7S* The prograi 
description defines outputs, both in terns of institutional changes 
and in tens of student achievement, as well as reports on the 
-legislation and regulations under ^hich the prograis have operated* 
s^he next sectio:i is a detailed descriptions of the procedures 
followed atid th& instrunentatioti used to leasure these outputs* The 
findings of the evaluation contains 'detailed inforiation about the 
Tiuibers and types of participants and expenditure patterns* It also 
coTitains a discussion of the instltut^ional changes which have 
resulted froi tho ECE r^^fora. Since 4oie ESEA Title * funds ^re being 
used to serve very distinct populations such as handicapped iptudents 
and neglected youth, ^ speciaT section about these specialized 
efforts is included* Aiong the /findings are that ECE school are 
latcing lajor changes throughout latiy prograi areas, and that 
statistically, students iti the ECE process achieve significantly 
higher than do latched groups of studetits not in the prograi* 
(Author/Af!)' \ 
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L Introduction to the Report 



Till*; i:\-aluatum Report of ECU, ESEA Title L 
and ED\\ 1974'7S. is ii comprehensive report of 
the effects of local school programs^ kindergarten 
tlirougli twelfth grade, developed with funds from 
the federal Elementary and Secondary Education 
Act (l-SKA) Title I. the state Educationally Dis- 
aOvaniaged Youth (EDY) Act* and the early 
childhood education (KCE) rlifomi effort of insti- 
tutional change and student achievement during^ 
1974-75. 

1'SI:a Title i, i;i>Y; and KC>: each have indepen- 
dent goals, organizational elements, eligibility cri- 
teria, and evaluation re(|uirements. Tiiese three 
largest of Californiums supplementary education 
efforts tor kindergarten through grade twelve 
overlap, however, in general intent* specific provi- 
sions and actual participants. Tliis statewide over^ 
lap fr^iu^ntlytresults' in allocations to schools from 
more than one funding source. The consolidated 
application, designed pursuant to the provisions of 
Assembly Concurrent Resolution 1 27 (1%9), pro- 
vides a vehicle to bring together in a united 
(planning effort these various state and federal 
supplementary funding soprces, which were pre- 
viously fragmented and often administered se^a- 
rjtely. Programs are defined at the local level by 
the school plan,"and the School indicates how the 
various funds will be used to present a unified 
educational package. Because of the substantial 
degree of these overlaps, it has become clear that 
one consolidated evaluation report covering these 
three efforts is appropriate. ^ 

The reader should keep in mind, however, that 
although overlaps do exist, a comparison of the 
achievements in one instructional an^a with those 
hi an apparently similar area is invalid; this is true 
l^rimarily because varying eligibility requirements 



mean that very different mixes of students *are 
involved in each effort. For this reason, the 
evaluation report. tl)ough consolidated, neverthe- 
. less contains separate* detailed evaluations of the 
achievements of students in programs funded by 
each of the three funding sources* and it also 
contains some discussion of thef^ programs* unique 
features. 

This report contaiiis(I ) the program description 
for ECE, ESEA Title L and EDY; (2) the pro^ 
cedures, instrumentation, and limitations of the 
study; and (3) the findings of the evaluation. The 
program description defines thc*outputs/both in 
terms of institutional changes and in terms of 
student achievemeiit^ which the reform effort is 
attempting to accomplish* as well as the legislation 
and regulations under which the programs kave 
operated. The procedures, instrumentation, and 
limitations section is* a detailed description of the 
procedures followjed and the instrumentation used 
to measure these outputs. The findings section 
^contains detailed Information about the numbers 
^nd types of participants and expenditure patterns; 
it also contains a discussion of the institutional 
changes which have resulted from the ECE reform 
effort. Student achievement resuUs are prexnted 
for progrUiHs funded by ECE, ESEA Title I,- and' 
EDY. Finaliy. since some ESEA Title I funding 
a4ministered directly by various state agencies is 
bein^ used to serve very ilistlnct groups of students 
in unique programs, a special section about these 
specialized efforts is also included. 

Both a summary of this evaluation report and an 
appendix are available upon request to the Depart- 
ment of Education. The appendix, which was 
produced as a separate document, is an exhaustive 
compilation of the original data. 
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!L Program 

This scLMion of Ihe cvaluiitipn report gives tlie 
rpiidcr II background against which to measure tlie 
clYeots or the three rundingV)iirces. It provides an 
overview oi the enabling legislation Tor bCt\ ESbA 
Title Land UDY, Tpllowed by participant, funding, ^ 
iinJ eligibility mpilrements. The assumptions for 
these "programs are presented, followed by an 
otitlint^ of the policy requirements. These require- 
ments deiil with institutional chimge and student 
iichievemont. 

Enabling Legislatiou 

When the ' enrly eliildliood education (hCE) 
reform effort was enaefed in CJiUpter 1402, 
Statutes of 1972. the California Legislature envi- 
sioned a restructured primary education designed 
to assure tlmt ^11 students in kindergarten through 
third grade wo\j!d receive instruction that would 
meet^ their unique needs talents, interests, and 
abilities. The Legislature colled for the cooperation 
and e\tetisiv^ participation of parents and the 
anuiuiiiut> 111 the education of children in these 
eaily i^ijjes. The Legislature alst> asked ttiat 
t\uj\u\uim use be made of existing state and federal 
tiuuK in a coordinated effort to help primary 
school students inerease their eonipeteneies in 
reading, lungtiage, and [uathematies skills and thus 
lieEp ensure (heiraehievenicnt in later grades. 

I!lc state funded program for ed\ieationally 
d(s:id\aiitai:ed yontli (lU.'Y) w;is designed to pro- 
akIc tiiLdily Alueatioind opportunities for students 
wluKc educational disadvantago hati resulted from 
l<nv tjinily income, language barriers, and tran- 
sioney, f lie I l>Y progran^ was autliori/td in 
(hjpter 1400 of the Statutes of r>72('SBOO). 
* Siiiiilarly, by eiiaetiiig Titl/I oj the Kleinentsjry 
.uid Secondary I diiealioii net (l:SKA) in l*)(>5 
tP.t. 8^)-IO. as amended), the Uniled States Con- 
j:ress provided financial asi:istaiiCe for the anginen- 
t;ition of ed\k'utioiiaf programs for students from 
hnv-mcoiue liinulies. The C alifornia State Depart- 
ment ol Itiiivation alloeales aii<l monitors basic 
!;raats of money to local edueatioiial ageneies^ 
qu.dit\ing for the I^ShA Title I fiiiids, 

1:1 developiiii: a pr^^gram, a local sehool may use 
nue or a LOinbuijlioii of federal or stat*; monies for 



Description 

which it qualifies as long as it can provide a proper 
accounting of the furtds from each souree^ lii 
addition to the three main sources cited, the 
following were also sources of funds for the 
1974*75 programs: Mill^r-Unruh Basic Reading 
Act; Bihngual Education Act of 1972; bSBA Title 
1!, Phase 1; and the American Indian Early Child- 
hood Educatiofl' Aet. 

Participants. Funding, and Eligibility 
Early Childhood Educatioii 

The 1974-75 states budget provided $40 million 
for the support of KCE. which "involved approxi- 
mately one;lourth of Califorrtia's student popula- 
tion in kindergarten through grade three. On 
approval by the State litoard of lidueation of a 
school's proposed program, ECE money was 
granted' for -a school , on tJie basis of $130 per 
student ih kindergarten through third grade, with 
an extra $65 each for up to 25 percent of the 
kindergarten tlirougli" thirds grade students who 
were in the lowest quarter in achievement. 

An elementary school became an tCK partici- 
pating, school as a result of a lengthy planning 
process. Districts were asked to establish priorities 
and a master ^iftan for the phase-in process prior to 
the submission of the l*>73-74 school plans. 

In each year, iialf the LiCE funds for any one 
participating district must go to those individual 
schools in the district which have the greatest 
educational n^ed. 'Midncutional need'^ is defined as 
the percentage of students scoringjn the lowest 25 
percent on a standardizedi norm-rofcreneed mathe- 
inatics or reading achievement te^t. In the t1rst 
{h)73-74) school yeir of liCE impJementation. 12 
percent of the students in any duitriet in kinder- 
garten thro\igli grade three (K-3) were eligible for 
funding. If a gWcn district's single lowest achieving 
school contained less than 12 percent of the 
district's fbtal K'3 enrollment, the district could 
then bring in any other school U) make up the 
diftcreiia^ (but not if the combined K-3 cnrollnicnt 
of the two schools exeecued the 12 pereejit 
eeiliiig). Since tli^s ineeh.nusm meant fliat many 
very small seho9l districts ;ould each bring in only 
/ 

/ 



one scliooK more ttian Imli; first year IX U 
wliools were low-ueliievrng ones. "Schools" sliould 
not he eonfiised with "diitdrtn," Uowcver. Jhougli 
eaeh low-aehieving school necessarily had a large 
(uinibor of jndivi(hially Itiw-aehieving eliildren, 
l-( K served all the seliaolVK-3 students, including 
the liighcrsiehjcviiig ones. Beeaiiso l-.CI: serves all 
ehiklreii in a neliool, hCl outcomes eaii be 
expected to he higher than those for l:?il:A Title I 
^ ]i]ili;H^V programs, wl|ieh serve only specintly 
idontified participants m each .school. In HCL 
Schools these special ^populations contiimc to 
receive services from BSEA Title 1 and/or tDY 
monies., 

Consistent witfi tht/ liCl- policy of rewarding 
'.hose districts with tjic best overall performance 
ratini>s, tlie actual tot/il amounts approved for the 
second year variod frioni 12 to 30 percent of the 
K-3 stndcnls in any o/ie school district. Tlic highest 
rated districts were afllowed to expand 18 percent: 
other districts reeeiViUd varying amonnts down to 4 
percent, and others^ received no ex|)ansion funds. 
In the Second (h>74-75) year of HCK operation, a 
total of 22 percent of all K-3 students were 
iiK^ludcd in the reform effort. 

The h.CV. legislation requires that eacli partici- 
pating ICI: schipol be cvahiatcd and giveji a 
comptjsite score based on a quantitative estimate 
o( the degree ani( .sAcctss of program impknicnta* 
tioii. inipil progress, and flscnl expenditures. Table 
1 shows the factors examined and their weights in 
cicli successive jycar of program implementation. 

ESEA.Tittel I 

fit-lc I of the Klenientary and Secondary tdij- 
catio[i Act of 1%5 is similar in many ways )lo 
IJ)Y, hilt its source of funds is federal rather thun 
slate: 1:SI:A TiMe I hinds, granted liy t'ongress to 

IAH!J I 

Facior*. Rated in ECE Schools with Weights 
Assigned Each Factor for 1974-75 



Wei^jiht ^ivcn lo f^ictor ruted. 
expressed as a percent, 
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California according to the eligihility of each 
county, nre administered liy the State IXTartnient 
of Lducation. Funds are allocated according to 
formulas Da,^ed on census information and Aid to 
Families with Dependent Children (AHI)C) pro- 
gram data. The formula is contained in Appendix 
D-l. (Tlie appendix was prepared as a separate ' 
document and is available upon requei;t to the 
l>epartment of Ldiication.) 

Once ESEA Title I funds arc allocated to a 
school, students to receive tlie services are ^elected 
on the basis of their educational need, defined to 
include students scoring at or below the second 
qu£trtile on standardized achievement tests or tho.se 
who have serious learning denciencieii because of . 
linjgiiistic, social^ cultural, or economic isolation. 

In tlieiruse ot'HSHA Title I funds, districts miust 
provide extra services to participants over and 
aboi^ve what they provide to nonparticipating stu- 
dents, Tliere mus) be assurance that all services 
provided with KStA Title I funds are significantly 
greater in time, type, or intensity frt>m those 
offered in the district's regular program, While 
ESEA Title I funds may be used for students in 
preschool and in kindergarten through grade 
twelve, state regulations require that thcpc monies 
should fir^t be focused on the earliest school years 
in order to make the greatest impact early in a 
child's education. In accordance with the federal 
law. moreover, segregation of EOEA Title I .stu- 
dents on the basis of race, ethnicity, religion, sex, ^ 
or socioeconomic status is forbidden. 

District wide school jjarcnt advisory councils 
have been mandated by the state since 1^66 and 
have been a federal requirement of l-SEA Title I 
since 1971. Council membership niiist inchide 
parents of students eligible for Title I services. 
White parents who work for the school district may 
belong to the council^ p:irents who are not district 
employees must compose more than a MmpK: 
majority of its membership. Advisory^ council 
functions inchide program planning^ implementa- 
tion, and evaluation. 

Other special categories of students that are also . 
eligible to receive services uader l-SKA Title 1 
include handicapped stadeiit£> living in state insti- 
tutions, American Indian and niigrant students, 
students in state institutions for the nc^doetcd or 
deliiiqucnt, and students attending desegrated non- 
public schools if they live in an eligible iitteiidaiice 
area and are educationally deprived. 
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Educitiottatty t)]sgdvintiged Youth 

[-ducationally disadvantaged youth (liDY) funds 
arc ^jlocatcd to school districts pursuant to a 
tonnula which includes indices of bilingualisiiK 
transiency, and poverty. The formula Js pnfteiited 
in "Appcmtix 0-2. In 1972 the California Legisla- 
ture provided 582 million for caeh of three years 
of illl^lenlelltaUoll. In I 974-75 approximately $4.() 
million allocated to school district;^ was used for 
the implementation of EDY only programs, and 
mosi of the rcniainhig funds were used in schools 
leceiving otlTet state or federal funds. Whether the 
program was funded only by HDY or by the 
combination of sources, tor each KL>Y participant 
the wliool received between $350 and $550 total 
supplementary nionies, 

C>nce eligibility for BDV funding was estab- 
lished, districts selected those school attcndalnee 
areas which had students with tlje j^reatest ediica* 
tional need. Need was determined principally, by 
either the number or percent of students scoring 
below the twenty-Hlth percentile on standardized 
achievement tests in reading or in^ithematics. Other 
factors relating to school attendance areas, such as 
hicidcncc of bilingualism, student transiency, and 
poverty levels, were also used as det^jj^inants by 
districts in selected l:l)Y recipient scliools. ^ 

Schools were selected for (:l)Y participation on 
the basis of studctits scoring below the twenty-fifth 
^ percentile because they were consfdered to have 
the greatest educational need, and all of the 
identified students were served; however, even 
though the locus of attention was on the students 
achieving at levels below the twenty-fifth per- 
centile, students achieving above that level were 
also served. Under provisions of tht; act, EDY 
funds were used to serve only those students 
cnrtijk-d in public edut^ation programs. Through 
policy cslablished by the State Board of UJuca- 
tion. priority was given to serving students in the 
o;irly grades. | 

In compliance with legislative requirements, the 
State Departnicnf of Hducation developed a proce- 
dure for evaluating l-l)Y programs. An index of 
prt>gr:im crfcetiveness was derived from the con- 
solidated evaluation reports submitted by districts 
and schools. The index wias based on the extenf to 
which the stated objectives were met, proposed 
activities were hnplemcntcd, and students in such 
programs demonstrated proga'ss in academic skills, 
A'wcighted sum of, these criteria was used in the 
mdcx. with the t1rst two eouiittng one each and the 
third counting twice, following which the programs 
were numerically rank-ordered. This ranking was 



designed 1 to eommunicate to each program its 
relative standing among all BUY programs; how^ 
ever, it did not indicate the t]ualUy of the progi-am 
according to an absolute scale. In addition, tht^ 
State Dl'partment of Bducation rated the bl)Y 
^programs on an absolute basis of overall program 
effectiveness. The index scores, the relative rank- 
ings, and the complete consolidated evaluation 
reports were considered in making a professional 
judgment as to which HDY programs were of "low 
effectiveness" in 1974-75. 

Assumptions of ECE. ESEA Title I and E1)Y 

Tlie intent of MCa. liSBA Title I and KDY has 
been to provide for increased student achievement, 
particularly in^ the areas of readings language 
development, and mathematics. While I^EA Title I 
and EDY have addressed selected students^ who 
have had learning disadvantages, ECB has served all 
kindergarten through third grad^ students within a 
ichool. The ECE reform effort has gone beyond 
just changing the instructional program for selected 
students; it creates changes in the institution which 
provide a better learnitig environment for all 
students. Such institutionaf change results from a 
systematic reform of the ways in which the schools 
■ plan their programs, provide ser.-;<.e£> to students, 
involve parents, utilize commuiiity resources, and 
evaluate outcomes for purposes of rcplanning. 

It is important to note the assumptions about 
how to effect institutional change that underlie the 
ECE reform movement. Such assumptions are the 
basis of the requirements made of schools and 
districts participating in ECB. 

A major assumption of the LCli reform move- 
ment is that the more clearly a school can describe 
what it intends to do for students and why, the 
greater the probability that such planned activities 
will take place in a timely fashion and the greater 
the Mkelihoo^ that anticipated results will be 
achieved. Conversely^ the greater the degree of 
arnbiguity of the schocr.^ intent, the lesser the 
degree of timely -implementation of planned aetivi* 
ties and of achieving anticipated . results. This type 
of program description is embodied in a program 
plan to be developed at eaeli school by those 
indrviduals teaching staff and parents act)V*'ly 
involved in the reform effort. 

A second assumption is that program planning as 
,well \ls efforts to implement and evaluate the 
planned program is enhanced by a school basc(| 
advisory committee which broader^s the base of 
ilecision making at the schooh Such a school 
advisory commiMee is to be representative of 
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piirciils. coiniuiinily. Icuclimg sUitT. swppoY pcr- 
suiiiK-L jiul iiOiniiiistruioni lo ensure lull eolsiiJcr- 
.ition yf Iho^^rious vicwpoiiils ol" llh^sehtHil 
eoinnimiity-' allenialive slralegics lot "Tesolviiig 
problems, uiul full use of all available resourees. 

A third assumption is that students learn best in 
an individualized protjtrum in wtiicli there are 
nielhods of identityiniit and providing for their 
iiklividiud needs and interests, Tlie adult to student 
ratio mnst be low to assess adequately and-to meet 
sueli needs and interests. 

A fourth assumption is that the involvement or 
p;irer|ts is vitaU ( I ) parents aa' an important souree 
of talent lor implementing the protjtram; and (2) 



liild's L:lassrooin expe- 



parents' knowledge of their oli 
rienee enables them to reinforce at home that 
whieh the ehild is learning at sehooL 



Re<|uireiiieiits Relating to li|istitutional Change 

The following were defined\for the development 
of the l:,CI- reform eftort: \braad outliiiesi for 
dislriet level planning; school l^^'vel pjannin^: needs 
assessment; development of jorograni goals and 
objectives; eomprehensivc res triietu ring, including 
nidividuali/cd di;)gnostie instruction, staff develop- 
nienl and inscrvice training* parent particfpatjon, 
parent education, and student health needs; and 
fin.atly prognnn -evaluation at the local level. (Sec 
Appendix C'-^>, Policy for Harly Childhood Kduea- 
tion Implementation.) « \ 

Oistrict Le\et Planning 

l>tstrieis using a broadly reprcseiUativc district 
advisory cOinniittee vvitti responsibility to -the local 
^loverniiig board were responsible for developing a 
dislriet mii^ler plan for t:CT-; conducting a distriet- 
^Mde needs assessment on a school-by -school basis; 
esiiiblisliing district program goals and -objectives: 
and planning for an orderly phasing in of the 
district's schools into HCT. 'Hie committee was 
reipnred to inetude parent.sof primary age students 
and to include representation of the ethnic and 
socioecohomic groups present in the district popu- 
lation, as well as representatives of teaehcr^. 
administrators, aides, support personnel. \pom- 
immiiy serviee ageneies, and the business commu- 
nity. A majority of the committee had to consist 
of piirenis who were not district employees. \^ 

Schoot Level PUinning \ 

Schools, with full participation of the rcpresen- 
tJtive school advisory connnittecs. were ret|uii\^d 
to folU>w the ret|Uirements for the scliool-leV^I 
planmng process outlined by the state. The plans 



developed through the planning process were to 
include a needs assessment, setiool goals and 
metisurable pe/formance objectives, appropriate 
solution procedures or activities to close the gap 
between what wa^ and what was desired, a plan for 
both process and product evaluation and fccdbjck. 
a timeline of scheduled events, and a budget whieh 
showed the coordination of all resources in the 
school. The program plan was to consist of 
program components in reading, language develop- 
ment, mathematics, multicultural education, ^r- 
viecs for limited and non*[^nglisli speaking 
students, staff developnient, parent partieipalTon, 
parent education^ health and auxiliary services, and 
any other area which the school believed was 
appropriate to its own situation* 

Ne^ds Assesitmer* 

As a Urst step in plaiming, all schools were 
requin^d to conduct o .n'^eds assessment. 11iis 
assessment was to Ix' a systematic investigation 
into what is. what should be, and the differcnecs 
between the two, as well as an analysis the 
diserepanei^s in the program areas just cited. The 
needs apessnWnt eould be done in a variety of 
ways, but the school advisory eoinniittce-waii ^o 
participate. 

. I * 
IVofTini Qoals ind Objectives 

As pait of the needs assessment, each loeal 
sciiool determined the ideal outcomes which it 
desired and analy2ed the discrepancies. To plan for 
the elimination or reduction of these discrepancies^ 
the schools were required to develop participant- , 
based measurable or performance objectives which 
they wjshed to complete during the year. 

The 'development of objectives led to solution 
procedures. Tlicse procedures were stated as activi- 
ties with a schedule of events. Both proccsN and 
product evaluation at the local level were further 
ru^inirements for the plan. An additional ruquire- 
mcnt was a budget which illustrated the coordina- 
tion of all the school's supplementary funding. 

In the l^74'75 .school year, each elementary 
school receiving \iCll, KSHA Title I. or ItDY ftmds 
was required to develop a plan for the use of those 
monies. These plans were to cover all funding 
Sources in the school. Submission of school level 
plans to the i>epartment of T^ducation was re^iuircd 
only of KCI: schools. Schools funded only by 
BSEA Title I or 1:I>Y were not required to submit 
tlietr plans to the Department but were to maintain 
them on file within the school, where a stratiPted 
random sample wdS reviewed. 
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CiHiipreheiisivc KeMrvcluriiif 

Tl»c i-.Vt policies dcnni4-thc broad outlines of 
successful program areas in which^ the nocds^f 
students were io be :i!OkCs:M!d. I'lie plan!& were to 
addresss and the programs were to m)plement, the ' 
folKminti!- 

I . hiiliviiluulized diagnostic itistntction: Stit^ 
dents were to be individually observed and 
m)rked with, with knowledge of what eaeh 
/child could and could not do, and provision 
;was to be made for s^ucntial steps in his or 
\ ' her classroom experiences. The program w'ji% 
.\ to center around instruction in language 
, development, residing, mathematics^ and 
inulticalti^ral cducatlou. The total learning ' 
environinent and the abihty to organize^ 
^ diagnose, provide for continuous progress, . 
- \ prescribe, artd document each student's prog' 
' res.s were basic to the tni&tructional program. 
Alt appropriate adult;!;tudent ratio of 1:10^ 
was rccoiniiicnded. 
Z. Stuff det^ehpntent and insenicc training. TUc 
training of adults working with stuilcnts was 
to center around development of those skills 
in the :%dutts which were needed to carry out 
the program the school had designc^. ^Tltece 
^^»ls, therefore, a need for identifying the 
skiliss planning to provide training in them, 
ind implementing^ the program which was 
^ developed. ■ 

}.t\irent participatioh. According to the ECK 
Legislation, parents jnust be involved in all 
phases of the program in the planning, in the 
^ day^to^lay operation of the program, and in 
\|ts evaluation and modiHcation. The oppor* 
tttnity for this participation must be extended 
to all parents, and the pbn must contain 
}>roviNions for ways in whkli to niaximizeX 
parent participation. ^ ' \ 

4. Pan'tU education. Parent education programs \ 
were to he developed within eaeh liCK school 
and were to be based on the needs of the 
parents and community of the school. They 
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were to provide training in those areas which 
Would enable parents to be better able to 
participate in the school and, more impor- 
tantly, in their children's own learning. 
5. Student fieaith needs. KCb schools were 
required to provide for screening/referral and 
follow-up of student health needs. This pro- 
cess was to inclu^ consideration of the 
community's resources available in these areas 
and coordination of those nssources whenever 
possible. 

Although comprehensive restructuring was not 
nsquiTed in ESEA Title l and EDY, these programs- 
wen; required to individualize instruction in read^ 
ing. mathematics^ and language development and 
to provide staff development, par|/nt participation, 
parent education. and health and Auxiliary services. 
Auxiliary S'^rvices Jre those supportive activities 
and services not provided elsewhere in the program 
but necessary to the success or program partici* 
pants. They include pupil personnel services, 
library and media services, and health services. All 
multifunded programs were required to provide 
auxiliary services to support the basic instructional 
components. The services were to be made avail- 
able to participants in relation to their individual 
diagnosed needs. 

P^Qffam Evahiitioii «t the Local Level 

All school level plans were required to include 
evaluation and dissemination sections. These sec- 
tions were to deal with evaluation of both program 
implementation and student achievement through- 
out the year. 

Requirenients Relating to Student Achiev^fnent 

ECE\ESEA Title I, and EDY all stress,'as a 
major pihpose* increased student achievement in 
basic skills, with primary emphasis ^0[i reading, 
language developments and mathematics. In all 
three (Programs provision was to made for 
multicultural activities for students and special 
services tor students who were non-Bnglish or, 
limited-Enghsh speakers. 



ML Procedures, Instrumentation, and Limitations 



hi ordLT Ho evaluate fully the objectives of the 
pfi>£rjnis iiicludetl in this report/it is essential to 

^examine bath institut^nal changes and student 
outcomes. Conclusions based on a review of either 
the institutional chmge- or of student outcomes^ 
alone, could be signitlcantly misleading. The infor- 
niatioh to be con^dered provides a picture of the 
prc>gram in operation and a picture of the pro 
gram*s results. The measurement of institutional 
change is a very difficult process^ subject to many 
limitations. When a wide variety of instruments 
and approaches are used« however^ and when other 
measures/ such as the student outcome data, are 
L'oiDbined with them, they eonstitute the most 
useful tool presently available for deriving a collec- 
tive measurement of institutional change and pro- 
viding a comprehensive picture of the program and 
its total effects. By necessity^ this report is based 
on a series of measurements or examinations of 
carefnlly chosen facets of the total program. The 
evaluation of the whole program is therefore a 
eolleetion of several separate evaluations of parts* 
which tliv^ fit together to provide a picture of the 

' whole. 

Several data sources were used in the evaluation 
of programs receiving ECE,,ESEA Title K or EDY^ 
funds. While part 6f the information was used to 
determine participant eligibility^ another part was 
lor school, district* and state-level ptanning and 
evaluatk>n. Chart I shows the various data sources 
used in the evaluation of programs. These data 
sources are described in terms of; (1) type of 
program's involved at the local educational agency: 
{1\ name of the instrument used to gather the data; 
(3) ageney completing the instrument; and H) 
general description of the instrumentVcqntents, 

Specific Procedures* Instrumentation* ^ 
and Qiangcs 

School }jtvti Plans 

School l^vel plans were developed during the 
spring of 1974 at each school receiving ECE, ESEA 
Title I, or EDY funding. All ECE funded schools 
submitted their plans to the Department of Educa- 
tion prior to June K 1974, 
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Every plan involving ECE was read and rated 
independently by two members of the Depart- 
ment's ECE staff. Table 2 presents the distribution 
of plan rating,5cores for all ECE schools and an 
indication of the areas considered, (Appendix C^7 
contains a copy of the rating instrument,) 

Production of the school level plans was^ by 
itself evidence of planning and design within the 
loc^l school and was a local self-report of the 
completed needs assessment process. The rating of 
the plans provides a measure of the ways in which 
systematic planning could be translated to paper, 
Th^ rating was^ot^ however, necessarily an irjdica- 
tion of the schools* ability to implement su^ 
planning* ^ 

The plan rating covered several aspects of 
program planning, beginning with the needs assess? 
n^nt^ process; which includes identification of 
probl^ms^ahd goats* and continuing through objec- 
tives, pFQ^m description, evaluation and dissemi- 
nation^ a^d program budgeting. Sections of the 
rating form were of differing lengths, with the 
sections on program description and evaluation and 
dissemination having the most items and thus 
making the greatest contribution to the total score. 
These sections were also the most highly correlated 
with the total score and included such questions as 
this: ''Has the instructional program adequately 
considered all the required components at both the 
readiness and the instructional levels?" 

The individual items that were most highly 
correlated with the total plan rating were: 

I, The objectives ^are relevant and applicable to 
the ECE program intent (item 4,22 in plan 
, j rating form), 

; 2, The goals and objectives will faciUtate individ- 
ualization of instruction (item 4,26). 
^, Process and product measures will be part of 
^ the^luation (item 6,24). 
4,. The ev^timtiQii procedures facilitate individ- 

^ ualization (itenr6724).--^ 
5, The effectiveness of tlife"--yauious program 
Components can be measured separSteiyjilem 
6,25), ^ 
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INitii Soufc^u in tUt ConsolidaUd Evaluation of Pfogranut, t9?4-75 



\ 

Agency Involved 


Instrument used 
to gather data 


Agency completing 
Instrument 


t - 

, Description of 

Instrument 's contents 


District with ECE, ESEA 
Title I, or EDY funding 


Form A-127D 


^District office 


District *level allocation 
plans, application for 
runoxng ^ . 


Elementary^ and 
secondary schools with 
ECE, ESEA Title I, jjr 
EDY funding ^^^--^^ 


, Form A-127ES 
Form A-1^7Sec 
. (school level 
plan) 


Schools 


School level plans: re-^ 
view of needs assessment 
pr oces s , ob J ec t Ives , 
activities, .evaluation, 
dissemination, and budget 


Elementary schools 
with ECE funding 


School level plan 
rating Instrument 


State Department 
of Education 


Rating of school level 
plans 


Selected ECE schools 


P^rogram Implemen** 
tatlon* Quality 
review Instrument 

view) 


State Department 

of Education 
.(monitor and re- 

V XcW/ 


On site review and 
rating of prdgrams* 
Implementation 


Selected ESEA Title 1/ 
and EDV ^schools; some 
ECE schools 


Compliance review 
Instrument 


State Department 
of Education 

(Program review 
and Improvement) 


On site reviews of 
program compliance with 
statutory requirements 


ECE schools 


Form E-127I (Prog- 
ress Implementation 
report) 


Schools 


Three^...^ogres8 reports 
of progf^m^mplemen- 
tatlon ^ 



( IIARI I (ONJINn 1) 
Dutu Sources Used in the Cons5>]idute<t Evaluufion of Pro^niiRS. 1974-75 



Agency involved 


Instrument used*- 
to gather data 


Agency completing 
instrxunent 


Description of 
instrument * s contents 


Elementary and 
secondary schools with 
ECE, ESEA Title I, or 
EDY funding 


Form E-127P 
(Product evalua- 
tion report) 


Schools 


Product evaluation- — ^ - 
report: enumeration of 
pupils » program person- 
nel » and volujitf^ers ; 
pupil achievement on 
^^i^andardized tests (pre 
and post); and self"" 
reports on activities 
implemented » objectives 
accomplished^ and recom- 
mendations for fulfure 


Stratified random 
sample of schools with 
ECE, ESEA Title I, or 
EDY funding 


In-depth 
studies 


SPhools 

r 

1 ■ ^ 


Detailed product 
evaluation report in 
one of the following 
components : readings 
mathematics » language 
development » parent 
participation » parent 
education » multicultural » 
Starr oeveiopmenc ^ ano 
health and auxiliary 
services 


Districts with ECE, 
ESEA Title I, or EDY 
funding 


Form CAER 10 


District office 

* \ 


Financial report for 
each progran^-: ECE» 
ESEA Title I, and EDY 



TABLt 2 

Dbtfibutioii of Plan Rating Scopes fof All ECE Fiiiided Schools, 197^75 



Item rat^d 



7 

Needs assessment 

Problem identification 

Program goals 
and objectives 

y 

Program description 

Evaluation and 
dissemination 

Budget 
Total score 



Total 
possible 
score 



Mean 
score 



Correlation 
with entire 
plan 



36 
36 

63 
118 

144 
36 
432 



, 21.15 
21.06 

34.48 
58.94 

62*65 
24*86. 
217*32 



.7585 
*8071 

*9041 
*9277 

^9251 
*3692 
1*0000. 



N-2,350* With this correlation of *197 is significant at 

the ,05 level of confidence* ^ 



The items for optional, multicultural, and bilin- 
gual components generally were very poorly 
related to the plan rating as a whole; but for 
optional and bilingUiil areas, this result could be ^ 
result of the scorinj; method used. Since these 
items were »not required^ they were often left 
blank, which would have been scored as zero. A 
score of zero v^^is also given if the item was 
supposed to be in the plan but w^s of such low 
(luality that it could not be scored. \ 

When iill school plans had been received and 
rated, the results were returned to the schools for 
their use in IXiture program planning. 

Based on a review of the school level plan forms 
used in 1974-75, a revised form was developed and ' 
implemented for 1975-76. A new plan rating 
instrument was developed to coincide with this 
form. Measures of inter-rater reliability were made 
during the inservice sessions to train plan raters and 
after the plans were reviewed. 

Local Evaluation ht>ce^ 

Program operation for 1974-75 began in the 
scliooU in the fall. As Indicated, withjTn their plans 



each local school had an evaluation design. Its 
purpose was to provide the school with informa- 
tion for its own decision making. This -particular 
information was not desired for use at the state 
level and was not included in this report. 

Monitor and R«view 

The ECE management team performed a pro- 
gram implementation review at a total of 913 ECE 
schools in the 1974^3 school year. Of the 913 
schools^ 319 ECE schc^ls entered the program in 
l974-75>and the dtijef/594 schools were schools in 
districts which recei^ no expansion funding for 
1974-75^ schools whidi moved from partial to full 
funding in 1 974-75, or schools which had not been 
visited In 1973-74. / 

The monitor and/ review (MAR) quality rating 
form was developed by Department of Education 
staff in the summer of 1974. Each item selected 
for inclusion ^related to legislatively mandated 
portions and/or the guidelines of BCE. Each item 
on the MAR quality document was to be rated on 
a zero to nine scale, with zero representing "no 
evidence'* and nine **exemplary.*' Table 3 shows 
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VAHLL 3 

Areas Rated and Maximum Possible Scores 
m Monitor and Review Ratings. 1974*75 



Area rated 


Maximum 
possitde 
score ' 


Instruction-reading, language 
u cvcxupuicnu y ano msLnenia cic s 




Prescription-reading, language 
uevt^xcpiRcnL , ano matneniatlCS 




Documentation^r^ading, languagV 
d^fVeToptoent , and mathematics 


If 


Balanced curriculum 


' 9 


Optional components 


18 


Learning environment 


27 


Mult^iculturaX 


9 


Health auxiliary 


63 


Parent participation 


63 


Parent education 


18 


Sfaff development 


54 


Articulation 


27 


Maximum MAP^ score 


423 



Uic various a^pecls of Mie ECI: prograt)i which were 
ratetl and tlic possible scores "which could be 
oMaiiied. Appendix C-3 eontains a copy of Ihe 
instruiTtcnt used and criteria for its use. The 
reviewers were 30 Stale Department of Education 
consultants and 1^ outside consultants. All the 



reviewers were experienced teachers, and many had 
been supervisors, principals, superintendents, or 
school psychologists. The majority liad been pre- 
school or primary teachers* but some had tau^it 
upper grades or adult education. 

Training sessions were held in October and 
November, 1974. The first phase eoiisisted of a 
three-day inserviee meeting in the Department 
during which the reviewers studied and diseussed 
the rating instrument and the revieUr process. The 
following week, all Departmerrt trainees spent 
three days in sehools conducting reviews on two 
small samples of schools. Between the first and 
second series of audits^ a day was set aside for 
review of the process and discussion of problems. 
After Department personnel had been through the 
above process, the outside consultants were 
brought in. Each field team consisted of one 
Department person as team leader and either an 
outside eonsultant or another Department person. 
At the peak of the process, field teams; were in 
schools th ree to fjour days 4 week. j 
^ Some school visits included grades four through 
six as a cooperative venture with the Department's 
program review ar J improvement (PRI) team 
audits. (See the following section.) 

The interview schedule form and the MAR 
quality form were sent to a school at the time its 
■"MAR date was set. Prior to the arrival of the team, 
the school completed its own self-assessment, using 
' the same forms the state team would be using. The 
MAR process in the school consisted of meetlVg 
with the administrator, making classroom observa- 
tions^ and the interviewing staff and parents. At 
the end of the day, the team presented its ratings, 
commendations, and recommendations in an open 
meeting. Time was allowed for discussion and 
possible reconsideration of the ratings. 

Following the MAR visit, each school was given 
an opportunity to respond to the MAR process by 
returning a questionnaire to the Department. Tliese 
questionnaires are summarized in Appendix C-4. 
To measure the degree of association between the 
MAR rating and the school's rating of the raters;, a 
Pearson Product Moment correlation was conl- 
putcd and found to be .34. With a sample size 
/more than 100, any correlation above .195 is 
statistically- significant (p < -05), 

Table 4 displays the correlation between the 
MAR process and the other ratings collected "iVom 
ECE sehools. A 'comparison of the MAR ratings 
and plan ratings revealed a correlation of .13. Tlie 
correlation between the MAR and the process 
implementation report scores was calculated to l>e 
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TABLE 4 

Coifdalion of Stale MAR Process with Other Parts of School Evalualiom for ECE, t974-75 





Correlation "between. MAR rating and other ratings^ by source of rating 






Process 


Socio- 


School self- 






Flan 


imp lement a 1 1 on 


economic 


rating 


State 


Type of ECE school* 


rating 


report 


status 


(N=47) 


assessment 


First vear* N=H9 
ECE schools 

Sec^d year: N-577 
ECE schopls 

All ECE schools; 
NV896 


.2113 
. .0819 
.1270 


.2398 
. 1433 
.1706 


.3445 

.2778 ' 

/ 

.3123 


.6674 
.7119 
.6733 


.2071 



' *First year schools were thos^ with no previous ECE participation* Second year 
schools were those fully or partially funded in 1973*74* Seventeen schoo'ls were not 
included lit' this analysis because of missing data in, their program files* 



.17. A thlrtl conip:irison was matic between the 
socioeoonomio status of the scUool and its MAR 
soore. Tlic coFrelation was .31. 

A question raised in the review of the school's 
scli'-evaluations lcd4o a fourth analysis. )t appeared 
froin observation anti discussion that schools were 
able to use the MAR criteria to' produce self-^ 
evaluations that were consistent with the audit 
team ratings. A inoJcrately high correlation pf -67 
affirmed tins observation. 

A comparison was made in response to the 
question niised after the 1973-74 evaluation: **Do 
good MAR scores match up with improved pupil 
[performance?" This question is partially answered 
by the correlation between pupil performance on 
state assessment reading tests and the MAR scores 
reported in Tyble4. Tlie correlation was .21. 

Tlie MAR instrument was analyzed for indi- 
vidual item contributions and for the factors that 
rjppcjred to he most important in the overall rating 
of a school t^e Appendix C-6). The matrix 
correlation obtained on the 913 MAR documents 
indicated that the items on the instructional 
section (part 0 were highly intercorrelated and 
probably measured overlapping factOR- The 
screening/ follow-up items and parent education 
item^ appear to he measuring essentially the same 
factors. 



Three items on the instrument had very little 
relationship to the total score. One of these, 
Articulation with preschool programs," had very 
low correlations with any other item; the health 
items related only to^ other health items; and the 
multicultural items related only slightly to the 
self -concept one. 

A factor matrix analysis of the MAR instrument 
indicated that threet factors accounted for 863 
percent of the variation in scores: 

1. Seventy percent of the variation could be 
accounted for by those items related to the 
instructional component. 

2. Nine and six-tenths percent of the variation 
could be accounted for by those itcfms dealing 
with parent participation. 

3. Six and seven^tenths percent of the variation 
could be accounted for by those items related 
to health and guidance. 

The low statistical relationship shown between 
the various reviews-is not surprising. Each review 
was designed to be independent and to focus on 
different processes-planning, implementation^ and 
student achievement. Bach review was a picture of 
a given moment in a total process. The plan rating 
.reflected the schoors initial program. The MAR 
scores reflected the quality of the program at a 
given time during the implementation of the 
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Ltistriictionol program, TUcrcVore, in order to 
establish tlic relationship between planning imple- 
mentation and stvidentj achievement, it would'bc 
necessary to: 

1 , Nat only record and judge the quality of tlie 
eonteni of eai:h school pl^n but also record 
iUid make quality judgments about each sig- 
mfleant cliangAin both content and process 
on a regular basis throughout the year. 

2, Make a judgmelit about the degree to which 
the planned pr:igram is being implemented 
and the quality for the instruction as it affects 
the learner on a formative basis. 

Ihe MAR scores niay also be afTeeted by the 
presencc^af the obsehter. Questions of inter-raier 
, reliability were also frequently raised in respect to 
sucli on-site quality judgments. Training sessions 
and tlcUl testing of the instrument were carried out 
in 1074-75, but no ,statj,stical estimates of the 
reliaUlity of the instrument's appiication were 
made. 

Biised on the analysis of the 1974-75 MAR 
dpeument dnd process, a team of consultants 
redesigned the instrumentation/ Personnel from 
school districts and offices of county superihlen- 
dents of schools reviewed the revised form in the 
summer of 1975, THe new form clarifies the basis 
far judgments withii^ the instrument and provides a 
revised rating scale fO-5), Three ppints of view exist 
within the instrument: the implementation accord- 
ing iiy the school plan, the pfogress made toward 
restructuring or revitalizing, and the quality of the 
program. , Tlie suggestions provided by the local 
schools' evaluation of the MAR process wer^? noted 
and iriHuenced some changes in the inservice 
tmiitmg for MAR team members. Inter-rater relia- 
bility is being examined iil the fall, winter, an^ 
storing iy( 1975-76, Further training will be pre 
vided to MAR reviewers if the irtter-rater reliability^ 
is low. 

Program Compttance Reviews 

Compli:iiiee reviews were conducted by program 
review and improvehient (PRI) teams^ in 43 1 
schwis, 365 of which were ESEA Title 1 and EDY 
,and ()6 of which wer}t3 EDY only. 

The compliance rating forms used by the PRI 
teams were developed by Department ,staff in the 
summer of 1974. l*ach item selected for inclusion 
'related to legislatively mandated portions of BCE, 
i;Sl:A Title I, and BDY. The form had a simple 
.yes/na choice for each item. 



i A stratified random sampl^Svas used in selecting 
the schools for PRI visits. In those sampled, the 
district office and iiH schools receiving compensa- 
tory funds were visited, llie instrument was quite 
fong, so only key questions were asked. If a "no" 
Response was given to a key question, then addi- 
itional questions in that area were asked. If a school 
or district was found out of compliance, a plan for 
steps to be taken to change ihe situation was filed, 
Nq aggregation of the results of the visits was 
attempted. 

A revision has be^n made of the district and 
school level compliance documents , for 1975-76, 
with each item in the'-documents directly refer- 
enced to specific legat' -requirements. Training 
sessions for the application of the revised docu- 
i^ients have been held fot -^l elementary and 
secondly members who wilt^isit schools and use 
the instruments. \ 

l^x)fitss Implementation Reports 

j Each ECE school was required to submit a 
rogress Implementation reportf in November, 
iarcli, and July \f\ which it reported, on the 
number of activities it proposed to implement 
within each four month period and whether the 
activities had occurred on schedule (see Appendix 
C4S), The intent of this report wds to encourage 
schools to institute a time management system that 
wauld;allow them to organize their flow of events 
mqre Efficiently throughout the school year. 

roblems reported included management con- 
cerns, such as assignment of personnel.by the local 
district. For example, one school was unable to 
meet its scheduled dates for vision and hearing 
screening because the district reassigned the 
school's nurse after the school's plan was written. 
Schools were encouraged to amend their plans 
whenever such events occurred, and they were not 
penalized for nonimplementation if an amendment^" 
was filed prior to submission of the process report. 
There were limitations on the use of the 
information from the progress implementation 
reports. There was no monitoring or auditing of 
the reports. Since there was school level knowledge 
of their us& in the BCE expansion formula, the 
data may be biased. It was also found that this 
form ofsself-report data was difficult to interpret 
and seeni^d to an extra responsibility for the 
implementing scl^ls. Because the data were diffi- 
cult to. analyze, information from the progress 
implementation reports is not included in this 
evaluation. 
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^ l)ue to thc ji bovc mentioned problems with the 
^rosr^^ii implementation report data, such reports 
vwill not be required in 1975-76. 

^ Product Eviluation Reportji 

Uach school, whether funded through KCB, 
KSKA Title L or EDY, was required to submit the 
product evaluation report by July 15, 1975 (see 
Appendix C-2). This report contained information 
in three general areas: enumeration data, student 
achievement results, and self-report data on the 
attainment of locally developed objectives. While 
the cnd-of-year reports were aggregated across all 
schools having common funding sourccjs, the infor- 
mation was not audited on a school by school 
basis. 

Emtmeration data. Schools were aslced to pro- 
viik' the numbers of participants funded by each 
source within their programs, the numbers of 
volunteers involved in their programs, and the 
personnel hired by funding sources. Se1f*rcporting 
of enumeration data is generally quite accurate but 
lias limited usefulness beyond suggesting the scope 
oHhe program. 

Seif-report data. The self-report data provided in 
the product evaluation report related to the 
!>cht^ors judgment of its accomplishment of its 
objectives. Since the information for ECE schools 
contributed 10 percent to the final score for a first 
year school and 40 percent for a second ^i^ear 
schooL there existed reasons for schools to inter- 
pret their progress in the best possible light. Such 
information, even with the^assumptiott of good 
faith, was subjecjt to locai interpretation. There was 
no separate audit of this information. 

Student achievement result. The da^a presented 
in the areas of student achievement i^ame from 
objective, norm-referenced achievement tests. 
These tests are relatively insensitive to specific 
instructional programs -that is^ they measure 
\ general- objectives quite well but measure specific 
\ objectives poorly or only by inference. The instmc- 
V tional activities in any given program frequently 
\ .stressed Specific objectives and, hence, may not be 
\ measured adequately with normrreferenced tests. 
\ In such Cases norm-referenced tests tend to give 
\ underestimates of the actual instructional gain 
^ made by the students. To compound this problem^ 
a variety of instruments were used. The Depart- 
ment of Education was constrained, however, to 
^usc norm-referenced tests, since they make com- 
parisons among groups possible. It would perhaps 
be better to use instruments specifically designed 
to measure the acquisition of specific skills. To the 
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j^tejnt thgt^programs are unique and are meeting 
the unique needs of a variety of students, however, 
the results would be expressed as an unmanageable 
number of unrelated specific scores.. It would be 
impossible to aggregate them to represent perfoir- 
mancc of groups of students. Within these limita- 
tions, standardized norm-referenced tests are gen- 
erally the best aggregatable indicators available of 
student academic progress. 

Schools were required to administer stan- 
dardized achievement tests in reading, language, 
and mathematics on a pretest and post-test sehed* 
ule. The achievement tests used, reported by 
frequi^ncy of usie, are shown in Appendix A- 1 2. 
Typically, pretesting was conducted in October 
1974; and post-testing, in May^ 1975. The fre- 
quency distribution of time elapsed between 
pretesting and post-testing for schools is shown in 
Appendix A-13. 

Student achievement in reading, language devel* 
opment^ and mathematics was reported as mean 
raw scores and/or grade equivalent scores on^ 
standardized achievement tests. In reading, 33^ 
percent of the schools reported mean raw scores; in 
mathematics^ 36 percent did so. In reading, 22 
percent of the schools reported grade equivalent 
scores; 24 percent did so in mathematics. Report* 
ing of both mean raw scores and grade equivalent 
scores was done by 45 perc^t of the schools in 
reading and 40 percent in mathematics. All of 
these data were analyzed and reported^ using the 
school as a unit of analysis and weighting for size. 
In total, usable test scores were analyzed for 54 
percent of the participants in reading; for r4 
percent, in language development; and ^ for 51 
percent, in mathematics. 

While test scores have conventionally been ex- 
pressed in grade equivalents, many technical short- 
comings exist in the use of this particular type of 
derived score. Grade equivalent data are not 
appropriate for making longitudinal interpretations . 
of program effectiveness. Tlie apparent loss' in 
achievement from grades seven through twelve, for. 
example^ coulfi be an artifact of the way in which 
grade equival«(nt scores'are computed. As Coleman 
and Karweity noted about grade efiuivalent scores, 
"When tests/are scaled to create equal variance at 
each grade level, they uniformly show a declining 
slope as years in school increase. Starting at a given / 
distance betow the average thus means an ever^ 



James S. Colcmun »nil Nancy L. Karwctt, MfmirCi of Schoot 
Performance Santa Monieur Tho..Rand Corporation. 

My, 1970, p. 10. ■ 
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LiV^cr tlis(;iiK"C k^hiiid Uie uvcnitic curve.** A 
kcliiitcul ilisciissioii of llic si lorko mini's of grade 
aiiiivaleiU scorch can be Ibund. in llorst, lall- 
niadge, anil Wood.^ 

Ill {\m report grade equivalent scores were 
convcrteil lo gain scores measuring Ihe average 
months of gain per month of instruction during the 
time hctwccn pretest and post-test. 

(iivcn the shortcomings discussed above, i this 
year the Department is presenting, in addition to 
the grade equivalents, a standard score which has 
an arbitrarily defined mean of 50 and a standard 
deviation of' 10. The mean raW scores reported 
were converted to these standard scores. The 
pa'sentation of standard scores provides an analysis 
or achievement data ihat relate the program effects 
dnrhi^ the ye{ir to the program outcomes for that 
year. In addition to the^e characteristics, t?he 
stanilard score^^an be interpreted normatively/For 
c^^>lo. if students score 48 on the pretest/the 
^eore represents theif relative positioji' to a norma- 
tive group. If those students made a year's progress 
(luring the year, their post-test scores would also be 
4S. Thus, they liave maintained their same relative 
position at post-test tinie to the normative group. 
To the extent that the. post-test score is greater 
than the pretest $core, the student or group can be 
considered Us liaving made greater than a yearV 
growth. 

Several procedures were reexamined in order to 
(k^termine whether the gain scores reported could 
he explained by something other than' actual * 
improvei)ient in pupil achievement. Three sources 
of interference (problems) have been suggested: 

1. There might be bias in the Statewide averages 
because the irregular dala excluded' from 
computing statewide averages Wbuld be sys- 
tematically lower than the rest of the data. 

2. There might be a bias because of the statis- 
tical phenomenon of ^^regression to the 
mean/' which would artincialty inflate gain 
.scores: for students identified as having the 
greatest educational needs. 

3. There might be a standard ^ore gain bias 
because of the estimation procedures used to 
calculate estimated fall and spring norms. 

The Department does not have data sufficient to 
dismiss Completely these problems in data analysis, 
but the Department does have, data sufficient to 
put the problems in perspective; 



"D. Jh>fsi. (J. K. Ta]linj<lpc\ and C. W^hkI. Measttring Avhievc- 
/m'ftt (^itut^ tit Idtaolumai t^roiei'n\ (RM(' Report tJR*243). Lo-i 
Aiios.(\iLii. RMCCorptirdiion. OctolH-i. 1974, pp.9, tO. 



The l>epartnient has not attempted io sample 
from the total group of students who weri^'cxposed 
to a given'nistructioilal component. The test scores 
presented represent all the usable scores submitted 
to the state by participating districts. The number 
of. students whose scores are presented is smaller 
than the total number of students in <he program. 

Test information reported by districts which was 
either incomplete or contained procedural irregu- 
larities was not used in developing statewide 
averages. Examples of incomplete data and irrcgu- 
'lar' procedures included instances in which (I) 
either pretest or post-te^t information was omitted: 
(2) test results were combined for several grade 
levels; (3) test results ^Yere not given in either raw 
scores or grade equivalents; (4) the standardized 
test. used in the pretest differed.from the one used 
in the post-test; (5) out-6f*level tests were used; (6) 
nonstandardized tests were used"; and (7) no tf. 
results were reported at alL There was^a loss in 
usable grade one data because pf the absence of 
^Tall'' norms. 

A randomj sample of the data which were 
classified' as irregular and unsuitable for dat:i 
processing was reexamined, and individual schdols 
were contacted in an attempt, tp determine 
whether the exclusion of these data could lirfve 
introduced a bias in. the statewide averages. For 
Some irregularities, comparable figures could not 
be discerned* In the case of irregular first grade test 
scores, however, it was found that the average 
post-test scores of ^hools that did not report 
pretest scores were not significantly different 
statistically from the average post-test scores for 
schools that did report both pre- and post-test 
data. 

. In computing achievement gains, only scores tor 
those students for whom both pretest and post-test 
data were available were included. Approximately 
^ 25 percent of the students who took the pretest 
did' not take.th^ post-test, and 28 percent oV those 
who took the post-test did not take the pretest. 
The Department has also modified its data collec- 
tion procedures for 1975-76 to obtain additional 
information bearing on- this problem. Next^ year, a ' 
randoni sample of schools will be asked to report 
not ouiy the number but also the average scores of 
pupits who took the^ pretest but not the post-tesf 
and to report both the number and average scores 
of pupils who took the post-test but not the 
pretest. 

The^ effect of the "regression to the mean*' 
phenomenon was examined by estimating and 
attempting to *'remove'* statistical!^ the correla- 
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lion l)Clwcc-n i)rclcsl and post-test scores. The 
results showed th:il program participants still 
gained 2.1 standard scores mare than norm group 
estimatetl growth for the same period of time. This 
is a slight reduction ^of the 2.6 standard ^^ore 
improvement vis-a-vis estimated norm gxoup gains; 
thus, "'regression to the mean*' may account for 
part of the gain shown in the unadjusted scores, tn 
all lairncss. however^ it should be pointed out that 
the eoinparison which is being drawn between 
program participants gains and norm groups gains 
is a cOmpensatCM'y question: *^Are- participants, 
eatching up?'' Here, for these programs the re* 
ported answer is '*yes/\ but traditionally the 
answer Has been ^^io.'* Traditionally it has been 
reported that, nationwide, pupils with the greatest 
educational neeQ show substantially smaller gains 
than norm groups. 

It is possible that a bias exists in the standard 
score achievement gain data. This bias could occur 
if iQKi publishers* ^all and spring national norms 
were based not on fall and spring^standardization 
samples but on linear interpolation between annual 
midyear standardization samples. There is typi* 
t^lly a loss of learniilg over, the summer months or 
at least a decrease in the Tate of progress. As a 
result, test norms based on linear interpolation 
undtJrestimate norm group progress between fall 
und spring. The magnitude of this bias is not 
);nown. • 

The problenf of estimating fall and spring nornis 
exists partially because of the expense involved in' 
narming te*sts. One group of test publishers does 
not publish fall and spring norms at all.' The 
Department used the standard procedures for 
estimating fait and spring norms from the annual 
norms that this group actually does present. A 
second group of publishers does publish estimated 
fall antf spring norms for which tlie estimates are 
based on interpolation (usually linear) across actual 
anmial norms. A tliir4 group Qf publishers, includ- 
ing most notably the publishers of the Comprehen- 
sivt' Test 6f Basic SkiUs CCTBS). the Stanford 
Achkrement Test^ (SAT), and the Stanford tarty 
School Actuevemertt Test (SESAT), provides fall 
and spring norms which have been derived empiri* 
cally from actually administering their tests to 
norm groups in both the fall and spring. Collec- 
tively, this group provides empirical fall and spring 
norms for levx:ls ranging from kindergarten through 
the twelfth grade. The advantage of this empirical 
mtMhod fs that it avoids the possibility that 
statistical artifacts have arisen trom the method of 
linear CJitimation. 



To put the problem of estimating fall and spring 
norms in perspective^ the Department conducted 
analyses of achievement scores under the alter- 
native assumption that the fall and spring norms' 
from ^11 the tests followed the pattern of the 
empirical norms (in standard score units). Under 
this assumption* coupled with the assumption of 
no test selection bias, th^ program participants 
gained 1.9 standard scores more than norm groups 
for the same period. 

Scores were aggregated across the several stan- 
dardized achievement tests to obtain statewide 
averages and program averages. These average^ iire 
offered as summary indication of the a<^demic 
achievement of program participants, tt islim^or* 
tant to understand, however* that there arcjUmita* 
tions inherent in such figures,^ ^ \ 

The central question in assessing {>]X>gram effects 
on pupil achievement is: *^How well have t^he pupils 
in the program done compared to how tHey:^ould 
have done had they not been in the program?" 
Unfortunately, that question is unansw^trable. No 
■\ one will ever know how they would have done 
without the program. Recognizing this fact, evalua- 
^'tors have turned to ahernatives which provide 
some evidence* albeit limited and imperfect, about 
program effects. These alternatives involve drawing 
two types of comparisons:- those between program 
participants and norm groups and those between 
program participants and ^ matched S^ovp of 
non participants. r 

Throughout thisleport most of the p6pit achieve- 
ment data are presei^ted in terms or comparisons^ 
between program participants and norm gi'oups. 
The national norm fo^ achievement tt^st scores, 
whether expressed in raw score,, grade equivalent, 
or standard units* functions as a comparison group 
by representing the achievement level or achieve- 
ment gain of the average student in the nation. 
Comparison of participant achievement with norm 
group achievement is useful ii) that it reflects how 
participants are progressing relative to all other 
pupils of the same grade level ■ ' 

An additional source of eoinparison 'was pro* 
vided by data from the California assessment 
program (CAP). The reading achievement scores 
from CAP for 1973-74 compared second graders 
with their scores on a nearly identical reading 
achievement test in 1974-75 as third graders. These 

^TlteAnchor TestStudy. Wj^inglon: U.S. Govcrnmcni Prinlinp 
OUkx, 1974. 

"^Robert L. Linn, "Anchor Jtsl SluUy: The Lony, and the Short 
of Uf" Journal of Hducatioml Mvasureittent, Vol. 12 <3). 1975. 



;irc. thJ only longitudinal data: other data reported 
arc aoss-ncclional, representing different students 
at different grade levels. 

Tlie limited use made of tlie self-report data; 
eOupled with a design which wilt provide more 
in-depth information, has resulted in a, redesign of 
Ihe product (.^valuation report for 1975-76. Basic 
enumeration data "will be requested from eacli 
participating schoo). ^ Based on the results; for 
1974-75 pretest and post-test, information will be 
requested in raw mean scores; and f;ta^dard scores 
will be used for analysis. Information on aceom- 
plishtnent ot objectives, since it js required by the 
ix'l: legislation, will be requested. Kach school will 
also be sampled on one of several in*depth studies. 

tn^lepih Surveys 

An iiinlepth survey procedure was established as 
a data collection strategy to supplement the 
product evaluation. report. The purpose of the 
surveys was to obtain more detailed evaluative 
infurinatioii concejiiiiig reading, language develop- 
tuent. inathematicss nmlticultural edueatioiit staff 
developments parent^ participation, parent educa- 
tion, and health and auxiliary services components. 

haeli school participating in any combination of 
irii. HStA Title I. of EDY funded programs 
received one in-depth survey with detailed ques- 



tions about one and only one component. The 
sampling procedure was designed to yield a random 
sample of participating schools for each of the 
components surveyed. 

The percent of returns varied by component (see 
Table 5). Tlvu poorest return (45 percent) was for 
the parent education component. Tlie parent edu- 
cation ritum was primarily from ECE schools (95 
percent), while the muUicultural return tended to 
be from ESBA Title 1 schools (82 percent). This 
situation is important to consider when jone 
attempts to g^nenilize^ the sampling data to the 
total population of multifunded^ schools. ^ The 
previous cautions about self-report data should be 
observed when reviewing these survey result^' 

One further limitation tiere may be in the local 
recommendations which were collected: These 
were generated by people closely involved with the 
program, who had full knowledge of the situation, 
but wlio^may. not have been able to be objectfve 
about it. Such data are difHcult to aggregate. 

in-depth surveys will again lie employed in 
1975-76. Tlie range of th<; surveys will be iricreased 
to provide additional infonnation about p;jrticular 
aspects of the program and their processes. Addi- 
tional instruments with less dependence on self- 
report data are being developed to provide more 
useful information. 



TABLb 5 

Return of In-depth Survey Fonm from Schools Purtkipning 
in ECE, ESEA TiUe UmA EDY. 1974-75 



^here were no in-^depth surveys for the educational development, 
bilingual-cro&scultural, and optional components* 

+The actua^number mailed was probably greater than 405 because of 
variations which occurred during the mailout process* Consequently, the 
percent return data was probably inflated* 

■ • /. ' 





Number of surveys 




Funding source 
. (duplicated count) 


Component* 
surveyed 


Mailed 


Returned 


Frircent 
returned 


ECE 


ESEA 
Title I 


EDY. 


Reading 


405'*' 


405 


100 


177 " 


\1 277 


152 


Language 
development 


405'*' 


•309 


76 


153 


216 


125 


Mathematics 




■SCI 


89 


1/3 




1 £ 1 

161 


Multicultural 


203 


196 


97 


52 


160 


90 


Staff 

development 


405 


306 


76 


139 


^09 


133 


IPd 

participation 


405 


338 


83 


164 


239 


152 


Parent 
education 


203 


92 


45 


87 


52 


46 


Health and^ 
auxiliary 
services " 


405 


302 


75 


144 

_ u 


209 


129 

• 
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IV. The I^indings 



Hiis part oT the evaluation report lias been 
arranged recording to the llndings made regarding 
(I) the participants in ECE, ESEA Title I and 
EU\: (2) expenditures; (3) institutional ehange;- 
and (4f student achievement; the Hnal seclion of 
this part of the report presents information on 
programs administered directly by California state 
ageneiifs. 

Participant Findiiygs 

Program participants included students, parents, 
school personneU and other community members 
who participated in any ECE reform eftbrl or in an 
L-SEA Title I or EDY program. Students within a 
participating school who were in various special 
education day classesj^fittLiiul ^onaideicJ prOtram 



The Student Pferttciptnls 

A total of 806.752 students in kindergarten 
litrough gmde twelve participated in tlie consoli- 
dated programs in 1974-75, (See Figure 1 for the 
nnmbcQ of student participants by grade level.) 
Approximately 65 percent of the participants were 
enrolled in kindergarten through gnade three, with 



Number of 

Kfwd 



Numh^^r ofMudcnl paHicip«cia«cive4l(ifi1hous>iHls> 




Fig. 



Total iwmbet i>f stud«nK5eivcfl:^J52 



]. Number of student participants in ECE, ESEA Title 1, 
and EDY. by grade leveU 1974^75 



23 percent in grades four through six and 12 
percent in grades seven through twelve. Appendix 
A-1 presents the number of students by funding 
source. 

Of the students served in the consolidated 
programs^ more of them received services in the 
reading component than in any other instructional 
component. More than 770.000 pupils were served 
in reading; 580.000. in language developmcnt;and 
717.000, in mathematics. The numb^ers of partici- 
pants involved m at least 75 percent of the 
activities in eaciv component are presented in 
Appendix A-2. Participants who were involved in 
more than one component were counted for each 
component in which ib^y participated (duplicated 
count); ^ , 

/ ; 

E(jE. Schawl districts reported that 303,131 
students particiiMted tn the ECE effort in 1974-75: 
80.^57 in kindergarten; 79;433 in first grade. 
72v498 in second grade; and 70.643 in third grade. 

bSEA Title /. School districts reported that 
591,561 students from preschool through the high 
school grades participated in ESEA Title 1 activi- 
ties. Of the total number served^ 97.6 percent of 
the students were enrolled in the public schools. 
Enrollment data are presented in appendixes A-1 
and A-2. The greatest concentration of students 
occurred in the primary grades, where 60 percent 
of the participants were served; nearly 30 percent 
of the program participants were in grades four 
through six, while th^ remaining 10 percent were 
in grades seven through twelve. Table 6 displays, 
by grade level, the percent of students in California 
who received ESEA Title I benefits from 1967-68 
through''1974-75. ^ 

£DY. During the 1974-75 school year, 436.009 
students, kindergarten through grade twelve, 
participated in i^rograms augmented by education- 
ally disadvantaged youtii (EDY) funds or EDY in 
combination with other funding sources. Of the 
total number of students served, 38.634 or 8.9 
percent received benefits from EDY resources 
only. The number of EDY student-participants, by 
grad? level, is shown in appendixes A-l and A-1 
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tAttLt 6 

Percent of Students ReceKuif £S£A Title I Sefviceit CaUfoma 
by Crade Level Craups, |967^S Throufh 1974-75 







Percent 


of total ESEA Title I 


enrollment 


, by school 


year 




Grade level 


1967--68 


1968--69 ' 


1969-70 


1970-71 


1971-72 


1972-73 


1973-74 


1974-75 


Kindergarten through 
grade three 




41,8 ' 


. 50,4 


52.1 


51.9 


54.0 


56.5 


58.9 


Grades four 
through six 


22.8 


23.7 


3^.0 


33.9 


34.7 


35.3 


30.3 


29.8 


Grades seven 
through nine 


19.9 


20.7 


8.9 


9.1 


8.2 


6:6 ^ 


8.4 


5,7 


Grades ten through 
through twelve 


12.4 


10.9 ^ 


4.0 


3.6 


3.3 


2.7 


3.7 





NOTE: Figures for participants in preschool and ungraded programs are not included in this table; therefore, 
the values in the respective columns do not total lOO percent. 
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Volunteer PaHkif^ints 

Nearly ,000 liours per week of program 
assistance were* donated by 67,000 adult volun-r 
teers; an additional 61,000 students at all grade 
levels volunteered more than 1-56,000 hours per 
week. For ECB^42,727 adults and 36,871 students 
volu0t^ereTd^urihg an average week. For ESEA 
Title I programs, schools repbrted that during. any 
typical week in the school year, more than 39,000 
students and 37,000 parents volunteered their 
sendees. 

Employed ptcfsoimd ^ 

In addition to volunteer help, programs em- 
ployed aides, teachers^ specialists^ and resource 
personneL Appendix A-2 displays information 
related to program participants and persons em- 
ployt^d by consolidated programs. 

IJSEA Title L To implement /ESEA Title I 
projects in t*J74-75. school districts hired 14,634 
persons beyond those normally provided with 
school district funds. The percent- of positions 
funded, by category, is presented in Figure 2. Of 
the positions funded by ESEA Title 1, aides made 
up the largest personnel category. A complete 
listing of personnel employed by ESEA Title 1 
projects in 1974^75 is presented in Appendix A-2. 

FDY. To implement their programs, school 
districts used EDY funds tolncrease <heir staff by 
7.615 persons. Tlie percent of positions fundei^ by 
category is shown in F^ure 3. Findings indicated 
tbat aides made up the largest personnel category. 
A complete listing of personnel employed by EDY 
projects in 1974-75 is presented in Appendix A-2. 

Expenditure Findings 

The eiiriy childhood education (ECE) reform 
elforl in 1974-75 distributed S40.9 million. The 
1974-75 appropriation was $40 miUion* and 
S900,000 was carry-over monies from 1973*74, 

In 1974-75, as shown in table 7, more than 
$155 million was allocated to California by the 
federal government as grants and contracts to local 
and state agencies. 

During 1 974-7 5, educat ionally disadvantaged 
youth (EDY) funds totaling $84,600,000 were 
appropriated for expenditures, lliat amount, less 
approximately I percent for state administration, 
was distributed to 414 school districts throughout 
California. Approximately $4.6 million allocated 
to school districts was used for the implementation 
of HDY only programs, and the remaining EDY 
funds were channelled to schools receiving other 




Ailinim»lt^||ii - 1 % 



Fig. 2. Percent of personnel in ESEA Title I projects. 1974-75 




FUpil penon(»ft ^ 

Admi«tisttation'-l% 
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Fig. 3. Percent of personnel in EDY projects^ 1974-75 

state or federal funds as well. Tlie amouhf and 
percent of EDY funds and the variety of- EDY 
program combinations is presented in Appendix 
D-3. 

The allocations, expenditures, and carry-over 
funds for each of the three major funding sources 
under the consolidated application process were 
reported in a special eT^penditure report by August 
15, 1975. Although audit of the reports filed for 
each funding source was not complete at the time 
this report was written, it was po^ible to select for 
evaluation a random sample of reports from ESEA 
Title 1, ECE, and EDY schools. Each district 
reported a summary of the total amounts ex- 
pended for all .schools within the district receiving 
the specific funds. (See figures 4, 5, and 6 for the 
percent of monies expended in the districts' sam- 
pled, but since these figures were based on ^ 
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TABU: 7 

Educationdl Agencicji Reccivii^ ESEA Title I Project Giants in California, 1974-75 



Agency 


Amount of grant 


Percent of total 


Local educational agencies 


$132,577,018 


85.2 


State educational agencies 
Migrant education 
Handicapped children 
Neglected and delinquent 


17,007,082 
1,319,314 
1,448,082 


10.9 
1*0 
,9 


California Department of Health 


1,373,988 


.9 


California Youth Authority 


183,421 


.1 


State Administration 


1,530,940 


1.0 


Total 


$155,640,045 


100.0 




Employee be(H?l1»-tt% 



CcriificaicJ 




Employee ben«fits-M% 



Bookst supplies, 
Mcl equipment 
replacement 



Cvpitd outtiy-3% 
Contractetl services- > 2% 
tnilire<;tcasts-< t% 



Fig. 4..Budgel categories of ECE funds>y percent «f expen* 
" diXwt^, fram a random sample af unaudited reports 
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and equipment 
replacemeitt— > S% 

Contticled services 
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Cipltil outlay- < i% 
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Fig. 5. Budget categories of ESEA Title I funds, by percent 
of expendltt^. from a random ^mpte of unaudited 

reports t}i !*s (listntt MHuinJin*", r>74 7*1 
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and cquqimtMil 

/ Contracted 5«rvici^s 
^ \ *nd other expenses- 2% 

^ — Capil^ outlay'- >t% 

^ Indirecl costs- < 1% 



Fig. 6. Budgcl categorJe^; of EDY funds, by percent of 
expenditure, from a random sample of unaudited 
reports of one cooperative summary and 14 dbtrict 
liummaries. 1974-75 

s;iitiplc of the reports returned^ use c;iution in their 
interpret;ition.)' ' 

It sliould also bcf kept in mind that several 
funding sources ure frequently conibincd within a 
school, so that the pattern may simply reflect the 
decisions of which '*source" to use to provide 
spccitlc parts of a total local School program. 
Furthermore, the fund*; in all cases must be 
supplementary, not supplanting. 

The tCt data. Figure 4. indicate that in the 
IQ74-75 school year, approximately 55 percent of 
ihc pcf student allocation ($130 per student, with 
an extra $65 ibr up to one fourth of the 
disadvantaged students in kindergarten through 
grade three) was spent on salaries for support staff 
to lower the aduli:student ratio in the classroom, 
Certitleated salaries, employee benefits^ and books 
and materials were a smaller part of the program 
expend] turCii. 

In comparison, l:SEA Title I expenditures 
(Figure 5) showed a substantial percentage of cost 
going to teacher and supervisory salaries, with a 
sligjitly greater proportion of employee bencflts* 
Tlie employee benefits* health insurance for exam- 
ple, needed to be paid only to employees who 
worked more than half time. In m^ny schools, 



I n.Mulilt-d K'lHUls <>l 22 disthcl Mimmuiics of l«T^ (^spcndi- 
tMics. ot IH distrK-t summjMC^ o\ 1-.S1 A TiHc U und of 14 disiricl 
siimiiiLirH's jnd coopcratiw iMimiiurV of 1-1>Y expondHuics in 
}^74-7S wcm cofiipikd. Ol Uk^^ Mrt*ic wt-rv IWi> dklrkts with 
XhKv )n^itl^^if m>ukcs, sis witb ICt'/I Sl A lilk I. and tv,o Willi 



classiflcd personnel are hired forsligtitly less than 
half titne^ thu.s cltniinating the expen.sc of em- 
ployee benellts. An analysis of the participant 
flgures retjmed by schools (Appendix A-2) sug- 
gests that the 18 percent of certificated staff hired 
accounted for 33 percent of the expenditures in 
direct salaries and also a large percentage of the 
employee beneflts. 

The expenditure figures for EDY monies (Figure 
6) indicate that at least 71^ percent of the funds; 
were spent on teacher and pther certificated 
sa/aries. The classified salaries took JO i^ercent of 
the budgets, and another 1 1 percent went into 
employee benefits. Appendix A-2 shows that 75 
percent of the expenditures went to 44 percent of 
the extra perso*inel. The aides, who made up 56 
percent of the personnel hired, received only 10 
percent of the monies. This discrepancy is prob- 
ably due to the lack of employee benefits paid and 
the low salaries of classified staff. A school can hire 
several part-time classified staff persons for the 
cost of one full-time credentialed person. 

Since these figures were based on a sample of 
the repcrts returned, caution should be exercised 
in their interpretation. All 3,0bO of the school 
reports ^re being audited as finaf budget expendi- 
tures are established, and the percentages are being 
recomputed. 

Institutional Change Findings 

The ECE reform eTfort provided an **umbrella'' 
for institutional change within the ittndergarten 
through grade three schools. ESEA Title I and 
EDY services for kindergarten through grade three 
students were integrated into the ECE plan under 
the comprehensive **umi>rella," As a result, the 
overall findings in this section relate directly to 
those schools in which ECE was present ;howeven 
other funding was present in many cases. 

Since in-depth information was gathoredjrom 
ESEA Title '1 and EDY schools on staff develop- 
ment, parent participation^ parent educa^tion. and 
the provision of health and auxiliary services to 
students, the finding$ regarding these areas will 
include information on programs of all funding 
sources. Unless otherwise stated^ data in this 
section were collected from the product evaluation 
reports. 

The findings in this section will address those 
small areas for which it was possible to make some 
measurement or observation. This section wil! also 
attempt to provide the reader with fuller defini- 
tions of the diversity which developed at the local 
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school sites within^ each of the areas defined 
broadly by the guidelines.^ . 

District Level Ptamiiiig ^ 

In districts with ECE, district level planning 
occurred, and district advisory committees were 
operational in 1973-74, as evidenced by the filing 
of plans by all districts which participated in ECH. 
No further auditing of the data contained within 
these plans was made. No additional district level 
plans were requested or filed in 1974-75. 

School tevel Planning 

All schools performed school level planning. The 
liCE plans were subnMtted to the Department of 
Education during" tlic summer of 1974 -md were 
rated. Appendix C-IQ, contains the distribution of 
quality ratings on all items. 

Needs assessment process- The school l^vel plans 
contained a report of the needs assessment process, 
which had been conducted as the first step in plan 
development, and its results. All findings relate to 
KCK schools. 

The ways in which needs were identified varied. 
In one school ^ full day conference was held. All 
members of the staff, many of the parents, and 
some students worked in small groups to discuss 
what they saw the school doing well, what it was 
iloing poorly, and what it should be doing. In^ 
another school, members of the faculty and the 
principal met m homes with different groups of 20 
parents each, holding informal discussions about 
the !^hool. In a thir3 school, a questionnaire was 
£fent to' all faculty, staff, parents, and students, 
asking them to describe the good and bad things 
that the school was doing. 

Table 8 presents the data from the plan ratings 
which apply to the quality of the needs assessment 
process. Kach of the\ four criteria-parent and 
community involvement, staff involvement, survey 
of the kindergarten 'hrough grade three popula* 
tion, and assessment of the required^areas-were 
judged as having either no evidence, implied by 
context but not specified by operation, specified as 
a consideration and partially operation alized, or 
optimized by function, a potent operational factor 
in the program. The table shows the percentage of 
schools which were judged on each of these items 
in each <>f the categories, and this provides a 
general picture of the quality of the total process. 

As can seen in Table 8, on all four criteria 
more dian 54 percent of the schools specified as a 
consideration, and partially .operationalized, the 
needs assessment process* while 19 percent more 



had optimized the process and used it as a potent 
operational factor in the program. From tl^is 
evidence, it i^an be coi)cluded that needs assess* 
ment of a rather hi^h quality was conducted, in 
more than 75 percent of the schools. 

The quality of the analysis of the identified 
heeds was also judged in the plan rating. The 
statement examined included (I) the identiTied 
needs represent problems rather than symptoms of 
problems; (2) the problems which the identified 
needs represent are under the direct operational 
controt of the school or district; and (3) the 
identified needs relate to the program components. 
Table 9 shows that the quality of the needs 
analysis was, in approximately 60 percent of rhe 
cases, partially operationalized, while an additional 
17-25 percent of the schools were even hi^er in 
this area. The evidence, therefore, indicates that 
the quality of the analyzed needsNyvas geiierally ^ 
good; and that, particularly in the area of relating 
the rest of the program to the needs, the schools 
did quite well. 

■ Program goals and obfectives. The development 
of goals as part of the needs assessment! process 
frequently. ofTcurred at the same time th^t needs 
were ide^iffed^ At local schools groups would 
develop defit^d and measurable performance 
objectives in different ways. For exanjiple, one 
school had a series of evening meetings with a 
^ group of ten representative parents writing state- 
ments on goals or objectives. Another sct^ooKs staff 
i members wrote its objectives; then a l^^rge group 
\meeting was held for parents during ;which the 
objectives were either approved or modified. In a 
third situation, a small group of parenjis and staff 
members went on a weekend retreat, wrote the 
entire plan, and brought it l^ack tc^ the other^ 
parents and staff members for their i^odification 
and approval. 

From the plan ratings, less than 2p percent of 
the ECE schools had difficulty in hiaking clear 
statements of their goals or desired condition^, 
while more than 23 percent were judged as 
excellent. Further judgments about ihe quality of 
the goats and objectives were made on the basis of 
the following: 

LThe goals and objectives are directly related ^ 
to the identified needs as prioritized. 

2. The objectives are relevant and applicable to 
the ECE program intent. 

3. The program objectives are stated in language 
which is accurate and unambiguous. 
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TAltLl 8 

Plan Rarii^ of rhe QuaJity of the Nteds Assessment Pioct^ in £C£ Schools. 1974-75 fN=2350^) 



Percent o£ schools receiving each quality rating 



Item .rated 


evidence 


Implied by context > 

not spc^ j-cu 

by operation 


Specified as a 
consideration and 

tlonallzed 


function; a 
potent opera*- 
Crjuonax xaccor 
in the program 


The parents and community were 
actively Involved In the process^ 


1 




56 


19 


The staff was actively Involved dn 
the process^ 


. 1 


19 


62 


28 


A contprehei^lve survey of the K*-3 
child population was conducted. 


1 


22 


54 


23 


The process adequately assessed the 
required program areas^ ^' . 


1 


23 


54 


. 22 



*£ach plan was rated by at least two separate raters^ This N represents the individual ratings^ 



TABLK 9 

plan Ratings of the Quality of the Anaty^ cf Need^ Idehttified and 
Relationship to Han in ECE Schools. 1974-75 (N=2550*) 



Percent of schools receiving each quality rating 



icein rated 


No . 


Implied by context, 
but not specified 


Specified as a 
consideration and 
partially opera- 
c xonax xzea 


Optimized by 
function; a 
potent opera- 
tional factor 


The identified needs represent 

P L ODXeinS L oCrHe L Cnan oyuip CrOIuS 

o£ problems^ 


1 


lit 


58 


17 


The problems which the iden- 
tified needs represent are 
under the direct operational 
control of the school- or 
district. 


1 


19 


61 


1 

19 


The identifi^d^ needs relate to 
the progran^components. 


1 


.,13 


61 


25 



*Each plan was rated by at least two separate raters. This N represents the individual ratings. 



4. Tlic program objectives acquire performance 
wliicli is; observable and mea!;urablc. 

5. The objectives address outcomes rather than 
processes. 

6. The goals and objt^ctives will facilitate individ- 
ualization of instruction. 

Tlic quality judgments made about the gpals and 
objective!; from the plan rating of HCE schools are 
shown in Table 10. As can be seen, schools were 
belter able to develop goa)s tjian objectives, as 
evidenced by less than 20 percent rating low and 
Jiiorc than 20 percent rating high in goal areas, 
while almost 30 percent rated low and only about 
5 percent wcrv rated high in the areas dealing with^ 
objectives. In nil areas more than 50 percent were 
rated in the middle range:;. 

Tile program description section of the plan, 
which contained information ^bout the areas in 
which activities would be conducted, was judged in 
ECH plans on the quality of the planning in the 
evaluation and dissemination section, which out- 
lined the manner in which the program wquid be 
judged loeally, and the school level budget, which 
provided an estimate of the budget for ECE funds 
and all compensatory and othef supplementary 
funds. These sections were also developed in 
similar diverse ways. Specific information about 
the distribution of quality scores in these areas is 
included in Appendi.x C-IO. 

It is clear from the information provided from 
the plan rating and its analysis, that ECE schools 
throughout Califomia were engaged in a systematic 
planning process whicji included a thorough qual- 
ity needs assessment and resulted in clear goals and 
objectives on nwhiO:h plans for the operational 
programs Wqtc based. 

Compr^enstve Restructuring 

Evidence of the implementation of school plans 
and of the effect they had on comprehensive 
restructuring may be inferred from on^ite^monitor 
and review (MAR) data and the school-prepared 
self-report data from the product evaluation report 
and in-depth sti^dies. Appendix C-5 contains the 
di!;tribution, range, median] and average MAR 
Scores for the varioui; areas judged. 

Individualized, diagnostic instruction. Diversity 
a^xisted not only in the ways in which the school 
plans wea' developed but a)^) in tlie implemerta- 
tion of the program:;. All prb^nms were to stress 
an in(lividuali7.ed diagnostic, prescriptive approach 
to instruction. Within this br»uJ outline, the ways 
in which :;tiidents were in4ructed varied from 



27 



school to school. For example, a mathematics and 
reading test center was established in one school. 
Each student was tested'there, and the results were 
given to the classroom teacher. The teacher then 
established an appropriate two week lesson plan 
for each student, after which the students w/ent 
back to the test center for retesting and the cycle 
was continued. In another school, the teacher read 
every other day with each student, made notes 
about the areas in which the student needed help, 
and then gave a special assignment for the next 
day. in a third school, a classroom aide, under the 
direction of the teacher^ assessed each student. The 
teacher reviewed the assessments, decided what 
each student should do next, and had a volunteer 
do that work with the student. 

All of these are individualized diagnostic, pre- 
scriptive approaches. The common elements nre 
individually observing the student, knowing what 
he or she can and cannot do, and providing 
sequential steps for hit or her learning experiences 
in the classroom. 

While visiting the school, the monitor and review 
(MAR) team observed each kindergarten through 
grade three classtoom in order to determine the 
type of individualized instruction provided. For 
individualized instruction, ECE schools were rated 
by the MAR teams in reading, language develop* 
ment, and mathematics on the quality of their 
organization in providing for Continuous student 
progress; their continuous use of data from diag- 
nostic ^tests and systematic observation of indi- 
vidual student progress; their use of a continuum 
of instruction objectives as the b^sis for indicating 
ystudent progress; the availability of various pre- 
scriptive tasks, materials, and methods which are 
speciHc to the diagnosed needs of each student; 
and their charting or documentation of student 
progress. Table 1 1 contains the quality ratings 
given in each of these areas. In general, approxi- 
mately 50 percent of the schools were rated **higir' 
in their ability to perform these functions in 
reading and mathematics, with less than 1 0 percent 
below satisfactory. Although more than 75 percent 
of the schools were rated satisfactory or better in 
t)ie area of language development, on several itejns 
at least 20 percent were rated below satisfactory. 

The observers also were looking for evidences of 
a balanced educational curriculum, an effort 
toward restructuring and revitalizing of the learn- 
ing environment, and an improved self-concept on 
the part of the students. "Restructuring" did not 
imply a requirement to alter the learning environ- 
ment or the physical plant; it was intended, rather 



TABLix 10 

P\m Rstii^ of the Quality of Goals and Objectives in ECE Schools, 1974-75 (N=235(r) 







Percent of schools receiving each quality rating \ 


Item rated 


No 

evidence 


Implie^ by context > 
but ndt specified 
by o|)eration 


Specified as a 
consideration and 
partially opera- 
tionalized 


" Optimized by 

£tmction; a 
potent opera- 
tional factor 
in the pro-am 


There i« a clear statement of the 
desired 'conditions (through 
goal statements) . 


1 


16 


60 




23 


The goals and objectives are 
directly related to the ident- 
ified needs as prioritized • 


1 


15 


64 


20 


The objectives are relevant and 
applicable to the ECE program 
intent + 


0 


22 


61 


17 


The program objectives are stated 
in language which is concrete and 
and unambiguous^ 


0 


33 


52 


15 


The program objectives require 
performance which is observ- 
able and measurable^ 


1 


33 


51 


15 


The objectives address outcomes 
rather than processes + 


1 


29 


57 


13 


The goals and objectives will 
facilitate* individualization 
of instruction^ 


0 ' 


28 


^ -55 


17 



^Each plan was rated by at least two separate raters^ This N represents the individual ratings^ 
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TABLP 11 

MAR Ratiqgs of the Quality of Individualized Imtructiim 
in ECE Schools, l9t4-75 <N«9I3) 
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U) rotlod tlio action tukon by ttio indiviijual school 
to improvo its cducationul progruni. As examples, 
thk *'rosti-U!:tunng'^ might have been extensive 
ohunges in tho ^tuff organization in order to 
provide for teum teaching which would better 
iitilizo tlio skills of the teaehers, or it might have 
involved tlio establishment of learning centers in 
each classroom in order to individualize instruc- . 
tioii. On these items measuring the presence of an 
■ appropriate learning environment, 97 percent of 
the sehools were rated at or above the satisfactory 
' level. Appendix C-5 contains the ratings in these 
areas. ■ 

The innlepth studies on the reading* language 
developments and mathematics components of the 
HCE programs provide a pictun? of the diversity of 
curriculum in each of these areas. , 

The 177 KCL: schools sampled in-depth for 
reading reported a pattern of currieulum content 
that api>ears; to rellcct the traditional hierarchy of 
skills in mo^t reading programs. Readiness activi- 
ties sueli as visual-motor perception* memory, 
sequential skills, letter sounds/andTctter names- 
were most often used in the kindergarten and first / 
grade classes. Vocabulary and decoding skills were 
emphasized m Hrst and second grades, and compre* 
hension, stufy/locationaU and reading for specific 
purposes wore emphasized hi the second and tlii|^ 
grades. Tlie development of interest in reading was 
^ a part of the reading program for all grades but ^v^as 
least emphasized in kindergarten. 

A total of 153 BCK schools were included in the 
language development in-depth sample. The pat- 
tern of skill development reported is not at all 
clear. Vocabulary development, listening, under- * 
standing, recalling, and speaking skills were most 
emphasized across all gr^tdes. Writing/readiness 
skills were emphasized niost in first grade and 
a'ceived equal emphasis in kindergarten and the 
second and tl^ird grades. IX'velopment of spoken 
sounds vowels, consonants, and blends-occurred 
most often iti first and second grades and least 
often in' kindergarten, ttevelopment of voice and 
rhythm was concentrated at first and third grades 
and occurred least often in kindergarten. Writing 
skills, grannnar, composition, structural analysis, 
nnd reference skills were generally concentrated in 
the second and third grades. The list of evaluation 
instruments reported by schools as being used to 
cvaliuite language development progress evidences a 
heavy reliance on locally developed mventories, 
^ tests, and .seniles (see AppentHx B-7). 



The in-depth sample of the mathematics com- 
ponent included 173 l;CB schools, The pattern of 
emphasis clearly follows the traditional pattern of 
mathematics curricula. Kindergarten and first 
grades emphasized the readiness aspects of mathe- 
matics> the need for language development, ^count- 
ing* ordering, sorting, matching, and manipulatives. 
First and second grade emphasized numbers, arith- 
metic operations, and geometry (identification of 
plane and solid figures). Measurement, problem 
solving, statistics, patterns and graphs, and reason- 
ing >A^re most often found in third grade but were 
also 1^ substantial part of first and second grade 
'prot()rams. The sample school data indicate an 
interest in developing arithmetic nuniberand oper- 
atl(ins skills in kindergarten, including patterns and 
naiure of numbers as well as addition and subtrac- 
tion operations. How much of the kindergarten 
program is devoted to the nature of numbers as 
opposed to computation could not be determined. 

The in-depth studies on the reading, language 
/development, and mathematics components of the 
ECE programs also resulted in local school recom- 
mendations of tt^e areas in which, based on their 
own evaluations, they believe ithey needed to make 
improvements. ; 

The most frequent response of the 177 ECE 
scihools sampled in reading was that -they needed 
either to revise program content or to change 
program direction in order to improve their reading 
coiiiponent. The schools also indicated a need to 
improve their evaluation methods, encourage more 
individualized instruction, and use or purchase 
additional materials. Needs for staff training and 
more non-English materials were also mentioned, 
but less frequently.- 

^ In language development, the 153 ECE schools 
'^sampled recommended most often an increased 
emphasis on development of speaking, aural com- 
prehension, writing, and listening skills. Second, 
they recommended improvement of their evalua- 
tion techniques, including diagnostic instruments. 
Other general concerns were improving teacher 
awareness and increasing the individualization of 
the program to bring it closer w^the student*s 
social and academic needs. 

^"For mathematics the 173 sampled ECE schools 
recommended most often that they improve class- 
room and school facilities and the use of editca* 
tionat and manipulative materials and also that 
they improve their own evaluation procedures, 
diagnostic instruments, and general teaching skills. 

In 'the same in-depth studies, the schools were 
also asked to identify those outcomes in each of 
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the urcus which they foil were importunt but 
iiontestuhlc. The important, nontestahlc outcomes 
of the reuiUng program were believed to be 
increased interest, improved self-esteenu and in- 
crea^^cd niotivation on Ue part of children toward 
reading and classroom activities. A second unpor- 
tant nontestable outcome was increased parent 
participation and community Jnvolvemcnt whiclt 
lead to greater awareness and understanding of the 
reading program. 

l-'or the language development component, the 
important * nontestable outcomes that were re- 
ported were focused on the skills developed by the 
students listening, aural coinprehcnsiou, speaking, 
and writing Uhe same areas lliat the same schools 
most often believed needed increased emphasis in 
their new plan). The sampled schools also believed 
that development and improvement of language 
program content, an increase in student self- 
awareness, and (levelopment of positive student 
attitudes towards learning were outcomes of the 
program. Increased teacher awareness of the impor- 
tance of lan^jua^^v development was ilso cited. 

The outcomes most often mentioned as impor- 
tant, nontestable ones in mathematics were in- 
creased- student sell-esteem and positive attitudes 
and the improvement in student mathematical 
abilities. Increased teacher awareness, development 
of positive attitudes on the part 6f teachers, 
individnati/atJon of instruction, and increased 
parent involvement and student interest were 
Jnehided in the list of nontestable items* 

SuttJ ikwloptnatt Restructuring of staff devel- 
opment aciivitics ovcurred not only within schools 
fuiuk-d throuizh H I: but also in those funded 
thnniiih LSI A Title I and l-DY. Details of this 
information are containt^d in appendixes A-15 and 
:V20. Tile iiKtepth study information, which 
covered kindergarten through grade three schools 
funded by all three ^^ourees, provided information 
about the range of the activities, their nature, and 
the results o| local evaluation of Uieir etVcctiveness. 

Hie lU^jectives and activtUes reportc^^l in the 
in-dcpth study empliasized improvement of 
instruction m one or more of the tbitowing 
curriculum areas: reailing, writihg, oral language, 
matlicnutics. nuiUicultural education, and bilin- 
gual crcKs-cultural education. l\irent education, 
pjreot participation/cnmmunily involvement, and 
health;{m\ili:iry services were ^ilso included as 
topics. The major objecUves for staff development, 
as reported by the sample of 306 sciiools^ were 
methods to iEUlividuali/.e instructioiu use of 



diagnostic/prescriptive techniques, improvement of 
reading and inattiematics instruction, improvement 
of teaching skills rel^ted to .student behavior and 
motivation, and use of aides in the classroon*. 
F->oin the product evaluation report, 82 percent of 
these objectives were reported as acliieved or 
exceeded. The activities most frccjucntly reported 
were workshops (45 percent), visitations to other 
schools (28 percent), general meetings (17 per- 
cent), atr^ college courses (5 perceiit). Nine out of 
ten of the planned activities were reported fully 
implemented by the schools. 

Participants in staff development activities 
included administrators^ tl*achers, aides, und volun- 
teers the number and type varying from school to 
school. The in-depth study showed that aitendance 
at all staff development activities was mandatory in 
50 percent of the scIiook; in A percent, atten- 
dance at Some was mandatory; and in 20 percent, 
all activities were voluntary. Five percent of the 
^ schools did not specify whether tlitir activities 
were mandatory or volimtary. The amount of tijne 
allocated for staff developments activities varied 
widely from school toMehool, with the average per 
participanf ranging frjpm less than ten hours to 
more tiian 200 hourfi. Fifty-two percent <^f t'*^* 
schools reported less ifhan 60 hours of training per 
participant. Staff uevelopment activities were 
scheduled by 43 perjpeiit of the schools during the 
regular school day, by 37 percent, after schooLand 
by 20 percent, in the evening or on weekends. 

Effectiveness of staff development activities, as 
reported in the product evaluation report, was 
evaluated primarily on the basis of subjective 
judgments,, which relied heavily pii staff evalua- 
tions and teacher opinions. Less frequently used 
evaluation techniques were objective measures such 
as questionnaires and rating scales. 

The following staff development activities were 
rated ''effective** or "very effective" by 90 percent 
or more of the schools 'implementing the activity: 
workshops at the school level before school begins 
in Sepl ember, school or classroom visitations with- 
in the district, individual conferences, sciiool or 
classroom visitations in other districts, demonstra- 
tion school observation, workshops at the school 
level on released time during re^ilur ^chool hour^. 
grade level meetings, college courses conducted in 
the school or districts and worksliops at the school 
level after scliooI cIosl^s in the afternoon. 

The following staff developnienl activities were 
rated "ineffective" or "partially effective" by 12 
percent or more of the schools implementing tlie 
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.ictiMly yciKTiil tiiculty meetings: district, iiilcr- 
Ohliicl. nr oniiily level workshops: conlcrciKCs: 
and toHcgc coursci* on college cunipuses. 

I urtlicr iiitoriniitioii iihout stiitY dcvclopincitt in 
scIiooK wilh l:<, L funding is provided by the MAR 
duLi. As I iible 1 2 indicates, the quality of the stuff 
de\elopineiit ;iiid inscrvice trjininni wiis bused on 
the proijiranis' meeting the assessed needs of (he 
teachers, pjid uides. volunteers, and administrators, 
di*il the involvement of the staff in desiiiyiiiig the 
'stJu' development program. As can be seen, the 
greatest percent of schools were rated satisfactory, 
hi^i. atui exemplary in this area. It should be 
noted, however, thai the ability of the program to 
meet the assessed needs of the volunteers was quite 
a bit lower than in the other areas. 

In summary, it is clear that diverse staff dcvclop- 
mv;!t activities systematically relaled to the needs 
of program participants were occurring at a satis- 
tdctory level in more than 85 percent of the ECl: 
schoc^U. and that staff development and inscrvice 
training were occurring in all funded sctiOols. 

PiiMif parfuipaUotL Hor l-(*t. tSHA Title I. 
and [J)Y, the product evaluation report infonna- 
tion indicated that during 1974-75. a total of 
3i**>.(>3i* parents in 2^563 schools participated in 
acti^itie.^ in the schools. Approximately two-thirds 
of the reporting schools used a coordinator to 
implement ttiis^i component and indicated that a 
third of the contacts relied on phone calls, personal 
invitation, and notes. 

Opportunities lor paivnls to assess program 
needs a!> they perceived them were afforded 
throu^i a variety of methods. Participation in 
formal snrve>'i>, sehool advii^ory coinniittces, site 
\tsits, and parent-staff confcaMiccs were most 
fiequeiirly reported. In more than oO percent of 
the ! <, 1^ seliool plans, there was a strong indication 
that parent participation would be active and 
continuoiLs in all a^^pccts of the program, and there 
\^.is adequate evidence that parents would be 
actively involved in the classroom. 

I-or all grade sjians in HCI:. liSEA Title Land 
V\)\\ the product evaluation report showed that 
the most frequently reported objectives for parent 
purticipatton related to expected changes in behav- 
ior and pcrrorniaiice, advisory coinnuttccs, parcnt- 
tcachcr conferences, and school meetings (sec 
.\ppendi\ A-16). \i the kindergarten tlirough 
Lirade three level, additional emphasis was plaa^d 
on wsc of parents in the school and classroom and 
mvohement in program planning and program 
evalnation. L:ss frequently reporled at tliis level 
were <*hiectives relating to home-school coiinnuni- 



.cation and progmii awareness. In grades seven 
through twelve, less emphasis was placed on parent, 
participation in program planning and evaluation. 
Workshops and program orientation were stressed. 
It wii reported that most programs had cither 
attained or exceeded their objectives. These most 
frequently resulted in more knowledge related to 

*i;cliool goals, objectives, needs, and program; parti- 
cipation in schoo) activities; and improved atten- 
dance at advisory committee meetings. Program 
improvements attributed to the impact of parent 
involvement and referred to most ofteii by report- 
ing projects were mcreascd individualized instruc- 
tion, a closer school-community relationship, more 
parent participation, and better parent under- 
standing of the program. Infrequently mentioned 
were increased staff sensitivity, cuniculum changes, 
and better student attendance. Reports indicated 
that the activities which mTe most important to 
achieving component objectives were parcnt-teaclicr 
conferences, use of parents as aides, dissemination 
of program information, involvement in prourani 
planning and cvah^atioii. and advisory committee 
recruitment. 

Parent paificipation activities were evaluated as 
follows: 46 percent by enumeration of participants 
and activities, 30 percent by subjective judgments, 
and 24 percent by objective measurements. 
Knumeration data tx^ncentrated on number of 
parents participating, attendance and nuniber of 
homo visits made, and number or home-school 
contacts. Subjective judgments reflected parcMit 
advisory t^^mmittee responses, parent comments, 
staff* evaluations, teacher opinions and records, and 
reports. The objective measurements consisted of 
parent questionnaires, rating scales, and attitude 
scales. Many programs also relied on minutes of 
meetings in evaluation of component effectiveness. 

Additional information about parent participa- 
tion is available for BCE funded schools fr qg the 
product evaluation report. In the I .l6flH||^H 
schools reporting to the Department of Education, 
180,932 parents participated in the schoo! pro- 
gram, an increase of 54 percent over 1973-74 
participation. Schools reported they had empha- 
sized personal contacts and spt^cial activities (such 
as meals or outings) as ways of getting a wide 
representation from all ethnic and racial groups in 
the schools. Newsletters, often bilinguaL were also 
used to contact parents. schools were gener- 
ally using full- or part-tinie paid coordinators to 
iniDlcment parent involvement activities. Volunteer 
parents and teachers were also used, but less 



ERIC 



38 



TAtttl 12 

MAR Ratii^ of the Quality of Staff Development and lit^jvice Training 
m£t£ Schools, I974-75(N=9U) 







Percent of schools receiving each 


rating 




Iten rated 


No 

evidence 


Inprovenent 


Shovs 
proalae 


Satis* 
factory 


High 


Exeaplary 


Inservlce progran meets assessed needs of: 
Teacliers 


0 


1 


6 


30 


57 


6 


Paid aides 


1 


1 


10 


36 


47 


5 


Vo^ynteers 


2 


4 


21 


42 


28 


3 


Administrator {s) 


2 


1 


4 


29 


57 


7 


Staff has been involved in designing the staff 
development program* 


0 


1 




35 , 


51 


8 
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lri t|iioiuI\ I ho iliosl Ircqiionlly iiiviUiuiKd ohjcc* 
lor pjronl (nirticipulion in 1:( f schools 
strcNNoU iiaMtcr ijivolvoinciit of parent^ iii^'iii)^^'rs 
of scliool ;ulvisluy coiiiiiiittccs or us volunteer 
iIkIos. ^ I 

As H \ purjnts purttciputcil in the school 
program ,^\^t hoy were involved in needs usses:inient 
meetings, >^nrveys, und parent^stutT eonfercnees in 
order to iVovide input to the schools on the 
iMi>^irav> neeVis which they, the parents, pereeived, 
The iKirCnt'i' mvglvenient in^ the evaluation proeess 
Usually involved the ^dvisory eomniittee or a 
i|uestionnake sent to all parents. In sehools where 
the program objective was designed to involve 
parents iu program evaluation. I4^pereent of the 
objectives were not met (see Appendix A-16). 
the dillioulty <ir involving parents in program 
ovahuition was identified IVom the MAR data. 

Aeeording to the majority of the K in*depth 
yvunple rt'ports, at least hall' the parents partiei* 
pated tn parent hivolvement aetivities up to half of 
the tnne; m the remaining sehools san)pled, more 
than 51 percent 6r less than 10 pereent participa- 
tion was repor(:eilj 

As a Result or ini:rcasc(l parent involvenient^^KCK 
sehools reported increases in individiiahza(l<ri\:iof 
sehool-comnumity relationsltips. 
student attitude improvement, 
aeademie achievement '^ml 
i*reater staff member sensitivity to the needs of 
pdieDts were ^Iso reported, hut less freiiuenlly. 

In the MAR process, [xirent purtieipatioif and 
eomiiuinity involvi^ment were major eoneerns of 
the (>hser\"ers. 1-aeli school planned for the nse of* 
Its parent resourctts iu way.** that best met the 
uniipie eirennistane^s of tlie school and the eom- 
nuunty, In some schools where there were many 
worknlg parents, participation took the form of 
assistance outside of school hours. Other seliools 
were al^le to ohtain so many volunteers that they 
did not need ;is many paid aides as they had 
originally pbnued to hire. 

The MAR process judged the quality of parent 
participation in I'CI: schools on the basis of ( I ) tife 
regular meeting and effective representation of the 
parents and the community by Ihe school advisory 
eonnmttee: iZ\ the regular Involvement of parents 
in program planning, assistuiiee in classrooms, 
other supportive assistance, and program evalua- 
tion; {^) the eximMiee of an active program to 
,ironse parem inti^a^st and enlist support; and (4) 
the ability of the program to encourage home- 
seliool eomnumieatioii in easily understood lau- 
;iuai;e lable L> slio\^s'tlie ran^^e of rathigs in these 



instruction, closer 
and parental and 
Improved Stoden 



artas. hi more than KS percent of the schools, the 
i!>;ality of parent participation was either satisfac* 
tory, high, or exemplary. However, for parent 
involvement in program evaluation aetivities, ah 
most 23 percent of the schools were rated le!$s than 
satisfactory. 

From these data, it is clear that vast numbers of 
parents were involved in the programs in tfieir local 
sehools and that the involvement .was of many 
diflerent kinds. Given a 30 percent increase iii 
participating ECH schools from 1973-74, parent 
participation increased by 54 percent, a m^u'or 
growth, while in all schools, kindergarten through 
grade twelve, 389,638 parents in 2,563 schools 
participated in school ae ivities. 

Parent education Since parent needs varied 
considerably among KCH schools, there was no one 
approach to parent ed^i cation. In some areas, the 
parent education prognm concentrated on basics 
skills, which were identifled by the parents as their 
first eoneern, while in pother schools parents re- 
quested theoretical courses in ohild^ developments 

From the product evaluation report data, expan- 
sion of the parent education program in bCL 
sehools in 1974-75 over 1973-74 showed a 55 
percent increase in participants, as contrasted to a 
30 percent increase in participating schools. In the 
1,141 ECB'sehools with parent education pro* 
grams, 1 19,347 parents participated. A majority of 
the schools responding to the in-<Iepth sample 
indicated that parent education programs were 
provided in conjunction, with other educational 
institutions, usually adult education through the 
high school or community college. About half of 
these courses were offered for credit. 

More than 80^ per^^nt of the participating 
schools' parent education objectives were met or 
exceeded, as reported in the product evaluation 
report. Tfie 87 1:CK schools in the innlepth sample 
responded that the content of parent education 
offerings was usually determined by parents, 
teachers, administrators, or the advisory Committee. 

Schools rcporte^d that their objectives for parent 
education most often focused opi attendance at 
meetings and programs designed: to enable parents 
to understand mora about the| school program. 
Less often reported objectives Were those relate(! 
to education eoneernhig pupil attitudes and behav- 
ior (see Appendix A-17). 

In contrast to the objectives stated aboVepfhe 
most "effective" program topics, in terms of 
frequency of response on the sample form, were 
those related to child development. Informational 
topics, cither on UCU or the schools operation. 
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wcro iioxI,;iikI p;iroiit-slUclciil rci^ioiisliip topics 
wciv third. Programs on specific instructioiml urcus 
or tccUni(|ues. multicultural progrnnis, iind work- 
\l\o{K were Icjvs t>rtcn listed as ''effective.** 

l-'iirthcr ihtoniiation on the quality of the parent 
education activities was gathered iliiring the nion- 
itor and review (MAR) process. The rating was^ 
K:scd on parent participation in the design of the 
prourani, and parent participation in the program. 
As Iiihlc 14 indicates, more than 75 percent of the 
programs were judged siitisfactory, higii, or exem- 
plar). 

In contrast to the residts rcportcil last year, 
which Jndiciiteil some eonfusion between the 
parenX education ami the parent participation ami 
invoKement components, the schools this yt^ar 
appear to have developed ilistinct progran^s,^ 
There was a major increase in the quality anti 
participation levels of tC I: parents in parent 
educanon from the tlrst toihe second year. 

Health md auxiliary services. According to the 
self-rcport information from the product evalua^ 
tion report, the major auxiliary services objectives 
for kindergarten through granle twelve schools 
fundul by l-CH, hSEA Title I, and BDY were 
related to providing pupil personnel and iiealth 
services. Of the objectives listed, approximately 65 
percent referred to services provided, while 35 
percent were based on changes in pupil or parent 
behavior or pertbrniance (see Appendix A-18). 
SpA'ilie ot^jectivcs reported most frequently re- 
lated to providing health screening, psychological 
diai^nosis, referral .services, health e;caiiiination^ 
and UCiilth et!ucatit)ii. Tlic !e^s|^.freqttchtly men-" 
tioned t)hjectives^j5a:r4MnH:r^ to improving nutri- 
librmry'^Tkills. discipline, and parent-chiki 
relationships. 

Pupil personnel services that helpcil most to 
,ic!iie\e component objectives included in order of 
frequency individual eounseliiig, psyehotogical 
dia*>nosis. psvciiologicai services, and parent coun- 
seling. Tiie major health services olYered were 
vision screening, health education, health diagnosis, 
and nursing. The most common library and media 
activities included the provision of materials, li- 
brary instriietioiK personnel, anil general services. 

Tlic majority of mtIiooIs provitletl most of the 
services ealled for in their school plans. Serviees 
most often reported as fully implenrentcil ineluilcil 
health screening, refernil i;ervices, and imrsing. 
]hose most frequently listed as partially iniple- 



iiieiited were health education, home visits, and 
group counseling. Serviees planned but not pro-, 
vided typically iiicliuled nutritional education ami' 
group counseling, The auxiliary services most 
frequently added tp the program were speech 
therapy, nutrition, and classroom cooking (see 
Appendix A- 23), 

Analysis of program reports showed that 48 
percent of the evaluations of services were deter- 
mined by subjective judgments; 33 percent, by 
enumeration data; and h> percent, by objective 
measurements. Positive results were most often 
related to health and nutritional objectives. Nega- 
tive results were most frequently related to improv- 
ing school attendance and reducing learning dis- 
abilities. 

The innlepth sample of 302 schools rated the 
level of effectiveness of specific auxiliary services 
in meeting their school objectives. Pupil personnel 
services ratings were 91 percent ''effective" or 
''very effective.'* The most effective were speech 
therapy, welfare and attendance serviees, home 
visits, and learning disability diagnosis. Health 
services were rated as 96 percent '^effective'* or 
**vefy effective," Tlie most effective were speech 
and lieanng screening, vision screening, use of 
health aides, and nursing. Reports from 87 schools 
included ratings of/library ^rvices. Ninety-one 
percent of the ratings were '*eftective" or "very 
effective.*' The most, effective services provided 
were mobile centers, learning centers, general 
i^ervices, and facilities. 

Of the specific results reportjjW by 302 schools 
in the in-flepth surveys, 62 /percent included 
changes in student behavior or perfonnance. Only 
33 percent were stated in terijps of services pro- 
vided, Tliese results refiect a mut^h greater emphasis 
on program outeomes than projeet objectives 
had indicated. In contrast, \iC\l schools sampleil 
showed services, or inputs, receiving the most 
emphasis. 

Positive results reported in the product evalua- 
tion report in relation to stated objectives are 
presented in Appendix A^I8. From ttie resulting 
improvement in personal health, attitude* self- 
image, health knowledge, aeademie achievement, 
and adjustment to school, it is evident that 
auxiliary serviees were effective in these school . 
programs, ifelatively few schools, however, re- 
ported improvement in the areas of interpersonal 
relations, learning disabilities, or developing cliil- 
dren's potential as a result of auxiliary services 
provided. 
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MAR Ratings or the Quality of Patent Participation in ECE Schools;. 1974-75 (N=9t3) 



Percent of schools receiving each rating 



It^m rated 


No 

evidence 


Needs 
improvcnkent 


Shows 
promise 


Satis- 
factory 


High_ 


Exemplary 


The school advisory coomittee meets regularly 
and effectively represents parents and the 
community* 


1 


1 


6 




50 


\ 

12 


Parents are regularly involved in; 
Program planning 


U 


J 




\ 

An 


17 

J / 


o 


Assistance in classroom 


1 


3 


12 


28 


44 


12 


Other supportive assistance 


0 


1 


8 


32 


48 


11 




t 


4 


18 


44 


29 


4 


There is an active program to arouse parent 
interest and enlist supports 


0 


0 

T 


9 


30 


47 


14 


to The program encourages home*schooI conoiunica* 
tion in easily understood language* 


, 0 


0 


5 


29 


54 


12 



TABLE M 

MAR Ratings of the Quality of P^fent Education in ECE Schools^ 1974-7$ (N^9I3) 



Percent of schools receiving each rating 



Item rated 


No 

evidence 


Needs 
improvement 


Shovs 
promise 


Satis* 
factory 


High 


Exenplary 


Parents participated in designing a parent 
education program which reflects their 
needs and interests^ 


0 


3 


19 


43 


31 


4 


Parents are participating in the parent 
education program* 


1 


4 


20 


42 


30 


3 
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I lie I C'I' [>rograiii rci|uirc:> a licaltli needs 
.issessinem. but no other lie.iltli or auxiliary areas 
are mandated. In [-('1: sdiools that inehided ESEA 
Title I aiul/or l:l)Y luiiding, auxiliary service;* such 
:ts eounseltng and library raeililies must be pro- 
vided lor USliA Title I and l-OY participating 
slndents. Most LCI: sclioois ;ire luoviding a com- 
prehensive health ediieation program and are fol- 
lovving lip the needs assessment with referrals and 
^ervices. In the responses reeeivetl Troiii 144 KCL 
selioot;* in the iiMlcpth s^iinpk\ 72 percent reported 
aehicvin^: their objectives. The most fretiiiently 
used objective related to improvenieiit in student 
liealtii. The iieetl lor licaltli scrviees v^^as tleter- 
iiiined by leaehcr-siatT observations aiul surveys, 
piirejilal inputs, and student pcrtbriiiauces and 
surveys. 

The l(T st^hools otTerin^ health etiucation 
programs altnig with other ;>ervices reported that 
they had either htlly developed a complete health 
cdiie.ition eontimiuiii or had none at all. The 
schools also utilized eertaiii- eonmumity health 
resources il lliey were available in the area. Since 
some rural areas had very limited local resources, 
extensive ontreaeh clTorts were provided- to meet 
the itLViis ot.students in ^iniall schools. 

The (|uulity raliiig or health and auxiliary 
services in the MAR proeess was based on meeting 
(he Heeds of individual students through health 
scr\iees sereeiiing,Velerr-al aiitl tollow-up. guidance 
st^r\iccs screening/ referral and Ibllow-up. provision 
of bilingual counselor/psychologists tluent in "tlie^ 
studeiUs" limguage(s}. use by the teaehers of health 
scTccmng data, uiul provision of a eompreliensive 
health ediicatton program. As Table 15 indicates, 
(he qiialii> of the program in these areas was rated 
in more than ^>0 percent of the schools as 
s;ili>foetory. high, or exemplary. It sliould be noted 
diat tor one item, the provision of bilingual 
eounsclors, fi4 percent of the schools fell within 
die area of no evitleiiee or not needed. This figure 
repascnts 5>iH schools. In 5S4 the item was left 
blank. In four seliools. die item was rated asO, an 
mdieadon that such services were needed and that 
no cviilencc of their existence was found. 

f rom the responses received in the sample data, 
.md trom the MAR data, it appears that integration 
nt health .md auxiliary services with the total 
ediieatioiial program was the goal of most schools 
.md was occurring. 

Prognm £v:ilu;ition □{ iiie Local L^'vels 

All school level plans eomiiiiicd evaluation and 
dissemiii.LMiMi provisions which were parallel to the 



activities proposetl. Since schools were retjuiretl to 
report to the state on the etTectiveness ot" these 
^ activities at the ^'onclusion of the program, the 
data subntitted to the state were considered evi- 
dence of the evaluation process at tlie local level. 

The in-depth study information for liC\\, b^SI-A 
Title 1, and EDY revealed that 26 percent of the 
reporting schools indicated parent partieipation-iii 
ttie evaluation of the local school was accom- 
plished through advisory committees. Parem re- 
sponses on surveys and questionnaires were used in 
21 percent of the schools. Objectives relating to 
parent participation in evaluation were achieved or 
exeeeded in 75 percent of the schools.- 

Summary of the Section 

As indieated in the beginning of this section, tlvc 
information provided gives the reader clear indica- 
tions or the effect of the total reform effort in a 
variety of areas. In order" to gain a broader 
impression of the net result, the reports from five 
iiCE schools with the highest MAR scores (scores 
from 346 to 423) were reviewed to obtain an 
impression of the characteristics^that appeared to 
distinguish a ^'^good'' school. The impression cen- 
tered around two common tliemeS- a well orgart**. 
ized management system in the school and the 
classroom and a combination of ^'dedicated and 
enthusiastic'' parents and staff. Words such as 
"warm," '"friendly," and "well managed." char- 
acterized the reports of the consultants who visited 
the schools. 

In Comparison^ the ratings of the five lowest 
. ECE schools (scores from 36 to 169) were also 
reviewed for common characteristi^ts. The contrast 
was striking. The lowest schools were conmieiided 
for their "evident concern." *'3lVort," and 
'*at tempting to improve eommunicatioii." The 
negative comments covered several areas:j[l) lack 
of compliance with federal and state gitic^olincs; (2^ 
poor management of staff and rcsourctijs^: 13) lack 
of well defined or balanced currrt^ulunr. and (4) 
inadetjuatc participation of the advisory commit- 
tee. Both groups of schools contained middle and 
low socioeconomic stiidents^ and both groups were 
concentrated in three areas of the state; Los 
Angeles County, the San Francisco Bay Area, anti 
the southern San Joaquin Valley. 

Systematic changes are oceiirriiig tn the manner 
in which schools are [Providing services to .students. 
These changes arc bnsed on systematic assessment 
of the needs of the local community, are ptanneiL 
and are evaluated. These locally tieveloped pro- 
grams include individiiali/cd^ diagnostic instrue- 
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tABLE 15 



MAR Rtiiing!^of theQJuJiiy of Health and Auxiliaiy Services 
m ECE Schools, 1974-75 (N=9I3) 



Percent of schools receiving e^ch racing 



Icem raced 


No evidence 
or 

noC needed 


T4ceds 
inprovcoenc 


Shows 
problae 


Sacls* 
factory 


High 


Exenplary 


HealcK services-physical^ visual^ audicory^ 
dencal^ speech^ paychological^meeC che 
needa of individual sCudenCs Chrough; 
Screening/referral 


0 


0 


4 


34 


-54- 


-g- _ 


Follow* up 


0 


0 




36 


53- 


7 


Guidance serviced meec Che needs of 
individual scudenca Chrough; 
Screening/referral 


1 


1 


8 


43 


42 


5 


Follow-up 


1 


1 


8 


4% 


41 


5 


Bilingual conunaelora/psychologiacs fluenc 
in ch« language of aCudenCs are available* 


64 


1 


3 


20 


11 




HealCh screening daCa are uCilized by che 
Ceachers* 


1 


0 


1 


45 


51 


2^x, 


There ts evidence of a comprehensive healch 
educacion program 


0 


1 


8 


56 


33 


2 
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tioiial proccdua-s, goals and objectives, stalT 
development and inscrviee training, parent partici- 
p;ition, parent cduiation, uiul concern for health 
and auxiliary serviecs. 

Student Aciiievenient Findings 

This section on student achievement findings is 
designed to give the reader an overview of the 
iinpaet of the various supplemental programs on 
the achievement or('alUbrni;i students who partici- 
pated ill l-( I:, KSI:A Title L and EDY. The 
iiirormation is reported by the various funding 
sources. Although the s^'hool was used as the unit 
of analysis, it should be kept in mind that only 
participating students' scores were used to deter- 
mine ihe school score. In tiCl: funded programs, 
this would niclude the entire K-3 population. In 
tSliA Title i and L-pY funded programs, only the 
scores of those selected students who qualified for 
and iKirtieipiitetl in the programs were used. School 
means were weighted by number of participants. 

The Hrst part of this section on student achieve- 
ment describes the tmdings of all kindergarten 
through grade three scho<)ls which utilized -ECE 
!unds, no matter what^other fimds were used. The 
second part deals with sclio)*ls receiving ESEA 
fiilc 1 monies. The third .seciion describes EDY. 
Tile last part on the achlevanWnts in bilingual/ 
cross-cLiliunil and nudticultural a\tivities describes 
Hhese prograinli funded by any s3()urees. 

BOB Umbrelta. Kindergarten Through Grade Yfiree 

Redding, Standardized achieveiinent data were 
analyzed by conversion from raw scores to stan- 
dard scores and by use of grade equivalent scores. 
A comparison of standard score gains from pretest 
to posi-test tn the several combinations of ECE 
multitundcd schools is presented in Figure 7 (see 
also Appendix A-{>). When examining the data 
expressing standard score results, tlie reader should 
keep the following in mind: A standard score of 50 
C(n)a]s the national average. Looking at the early 
childhood cduealion only graph in Figure 1, the 
reader will note that the pretest scores for kinder- 
gartens Jvcraged 40,0. The post-lcst score was 
5J .0. This represented 5.0 points more growth 
Ukui would have been expected in one year of 
instruction. It also indicated that at kindergarten, 
the senre cxt-ccdcd Uie national average in reading 
achievement on the post- test. 

An inspection of I-'igure 7 shows that post-test 
scoa-s tor grade one also execeded the national 
aver.igc, while grades two and three were closer to 
the national average on the post-test than on the 



pretest. In all grade levels (K-3), schools having 
ECE only funds exceeded the national average on 
the post-test. In schools having a combination ol 
ECE and the Miller-Unruh reading progra^m fund- 
ing, post-test scores excec((ed tlie national average 
for students in kindergarlen and grades one and 
two, 

Grade e(iuivalent gain scores in reading were 
calpulated for grades one through three in all 
combinations of ECE funded schools and are 
^ presented in Table 16. With an elapsed time of 8.2 
months between pretesting and post-testing, all 
grade levels typically achieved one month's gain or 
more in measured reading ability for each month 
of instruction. While performance varied among 
combinations of the several funding sources (see 
Appendix A-9)j there was a trend for grade 
equivalent gain scores across all funding sources in 
the primary grades to approximate the grade level 
expectancies of the students. 

The Department of Education used reading 
achievement .scores from the California assessment 
program (CAP) as an additional check on state 
evaluation of programs. All ECE schools were 
compared with non-ECE schools in terms of four 
indices: (1) average socioeconomic slatus: (2) 
number of third grade students; (3) total per- 
centage minority enrollment; and (4) 1974-75 
third grade predicted score on the CAP reading 
achievement test. The frequency distribution of 
ECE and non-ECE schools across the four indices is 
s]iown in Appendix C-ll. Much variation exists 
among both ECE and non-ECE schools. Yet^ it can 
t)e seen that compared non-ECE schools, the 
ECE schools on the average had indices oi' lower 
socioeconomic status^ larger school size, and higher 
percentage minority enrollment- 

Longitudinal profiles of performance in reading 
achievement were computed for ECE schools in 
the program for one year, ECE schooU in the 
program for two years, and a matched group of 
non-ECE schools. If schools were not funded for a 
third year, they were not included in this sample. 
Reading achievement gain scores from CAP. as 
presented in Table 1 1, follow the same schools for 
two years: 1973-74 and 1974-75. The reading 
achievement scores made by second graders in 
1973-74 were subtracted from their scores on an 
identical reading achievement test taken as third 
graders in 1974-75. As shown in Table 17, both 
one and two year E(l: schools showed statistically 
significant higher gain scores than non-ECE schools 
showed. 
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Fig. 7, Weighted average pretest and post-test standard scores in reading achievement, by grade level, for schools participating 
in early childhood education, 1974-75 
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Fig. 7. (continued > Wefghled average pretest and post-test standard'scorcs in reading achtevement, by grade levd, for schools 
participating in eariy childhooit education, 1974-75 



Since Iwo-ycar 1:CE schools showed slightly 
grcalcr gains .tluiii one year [:CK schools (15.7 vs. 
15.5k Ihk is vicwcvi as a positive result for the ECE 
I>rogr:ini lor ;it least two reasons. First, it puts to 
resi the contention ttiat HCK would have only a 
temporary elTeet that wouKi vanish in Ihe second 
year of operation, instead, there appears to be a 
eumiilalive elTecl over years. Seconal the two-year 
t:(T: scii^^ts liave a somewhat lower index of 
soeioeconoiine status than Ihe one year schools, 
wliich indieates that their gains would generally 
have been i^redieled to be smaller ihan those of the 
one-year 1:CI: sehool^i. 

Langtmge devetopment The usabie data from 
language developmei>( tests which wen; submitted 



from ECE schools in grade equivalent scores are 
reported by funding source and grade level in Table 
18. With the exception of grade one programs 
funded by the ECE, EDY, Mitter-Unruh combina- 
tion, programs in all grades and funding combina- 
tions gained niore than the expected 1 .0. 

The group achievement tests used to mcasun; 
language development activities usually assessed 
oral receptive language at the primary level. 
Schools using criterion-referenced instruments 
were able to measure expressive language develop- 
ment for individual students. Such information 
could not be aggregated at the state level. 

Mathematics, Both standard score and grade 
equivalent gains were calculated for sludents who ^ 
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Av^rjgif Months of Gain m Reading Grade Equivalent Scores for Each Month of Readini^lostructiaa 
for S^hools'Parttctpating in Eariy Childhood Education, 1974-75 



Number of schools and average months of gain 





Grade one 


Grade two 


Grade 


three 


Funding source 


Schools 


Gain 


Schoolis 


Gain 


Schools 


Gain 


'r 

ECE only 


> 77 


1.2 


161 


1.2 


162 


1.2 


ECE/ESEA Title I 


87 


1.2 


133 


. 1.1 


138 


1.2 


ECE/EDY 


7 


1.3 


15 


1.1 


13 


1.1 


ECE/ESEA Title I/EDY 


60 


1.1 


138 


.9 


135 


.9 


ECE/Miaier-Unruh* 


14 


1.3 


34 


1.3 


38 


. 1.3 


ECE/ESEA Title l/Mlller-Unruh* 


19 


1.3 


38 


1.1 


32 


1.1 


ECE/m)Y/M11 ler-Unruh* 


3 


1.2 


3 


1.3 


3 


1.1 


ECE/4sEA Title I/EDY/ 
Mil ler-Unruh* 


11 


1.2 


40 


1.0 


34 


1.0 


All ECE combined 


278 


1.2 


562 


1.1 


555 


1.1 



*NOTE; Mlller-Unruh funding was 
only for reading i 



present In these schools, and such funding was used 
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YABtl; 17 

Reading Achievement Gain Scores for ECE Schools and Matched Groups of Non-ECE Schools, 
1973-74 to 1974-^75, from California State Assessment Program Data* 



Type of school 


Third grade 
scores , 
1974-75 


Second grade 
scores, 
1973-74 


Gain scores 
(Number correct, 
1974-75, less 
number correct, 
1973-74) 


Two years In ECE (N = 427) 


79.2 


63.5 


15.7^ 


One year In ECE (N = 658)$ 


81.0 


65.5 


15.5"^ 


Matched non-ECE schools 
(N = 3,326) 


80.6 


65.6 


15.0^ 



*For a technical discussion of these data, see Appendix C-12. 



* «< - .001 



tone vt .IT schools Included those entering FCE In 1974-75» those wovlnp from 
partial to full funding In 1974*75^ and those few schools In dif>trlcts which 
received no expansion funding for 1974-75. 



ERIC 



43 



43^ 



roccivcil instruction in imitticnmtics, using the 
school IIS iho unit of analysis. Stamlard scores on 
the iHisl-lcsl indicutcd tiKU kinilcrt;Lartcn und grudc 
one cxcccticii ttic nationul uvcragc, while gniOcs 
two and three were less than one point below the 
national average. In all cases; post-test scores were 
higher 4han pretest ifcores. 

l:( E-only schools, grades one through tha^e, 
exceeded the national averages in mathematics on 
the post-test, with kindergarten scoring at the 
national average; The patterns of post-test scoa^s i*i 
^ehools having l:Ci;/l:SBA Title I ant) bCE/EDY 
funding were mixed: for KCE/ESEA Titk I 
schools, grades one and two exceeded national 
averages; for ECli/liDY sehools, kindergarten and 
grade three exceeded the national avenge. Figure 8 
presents the mathematies data by funding source. 

A eomparison of grade equivalent gain scores 
showed that, with an average elapsed time of eight 
months between testing, grades one through three 



demonstrjled an average increase of 1.2 months in 
measured mathematics skilU for each month, of 
instruction. Tlie findings by grjde level and fund- 
ing source are presented in Table 19. The greatest 
gains were found in schools having UVU only and 
ECE/ESEA Title 1 funding. 

A comparison ol' grade equivalent gains in 
reading ^d mathcniatif:^ was made between Hrst- 
year ECE schools in 1973-74 and first-year ECE 
schools in 1974-75. Tabic 20 shows the compari- 
sons of the respective first-year st^hools. Tl\e data 
presented indicate that during their first year of 
operation^ schools entering ECE in 1974-75 
showed significantly greater gains than did schools 
in their first year of operation in 1973-74. Since it 
was riot possible to match these schools, and the 
SiJhools reporting 1n grade equivalent scores in 
1974-75 represented less than half the total num- 
ber of schools 'reporting, these data should be 
interpreted with caution. i 



TAUll {H 

Average Monlhs of Gain in Language Grade Equivalent Scores for Each Month of Language 
Instruction for Schools Participating in Early Childhood Education, 1974-75 



Funding source 


Number of schools and average 
for each month of instruction 


months of gain 
, by grade level 




Grade 


one 


Grade two 


Grade 


three 




Schools 


Gain 


Schools 


Gain 


Schools 


Gain 


ECE only 


51 


1,2 


74 


1,5 


74 


1,7 


ECE/ESEA Title I 


57 


1.3 


76 


1.6 


78 


1,6 


ECE/EDY 


4 


1,7 


5 


1,2 


5 


1.6 


ECE/ESEA Title I/EDY 


33 


1.2 


43 


1.3 


' 44 


1.3 


ECE/Miller-Unruh* ^ 


4 


1.5 


11 


1.7 


9 


1,9 


ECE/ESEA Title l/Miller-Unruh* 


14 


1.6 


20 


1.3 


15 


1,5 


ECE/EDY/Miller-Unruh* 


1 


.7 


1 


2.4 


1 


1,1 


ECE/ESEA Title I/EDY/ 
Miller-Unruh* 


10 


1,2 


15 


1.3 


12 


1.2. 


All ECE combined 


174 


1.3 


245 


1,5 


238 


' 1.6 



*NOTE: Hiller-Unruh funding was present in these schools, and such funding was used 
only for reading* 
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Fig. 8. We^hted average pretest and post-test standard scores in mathematics achievement, by grade levels for schools 
participating jn early childhood^ education, 1974-75 
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Fig. 8. (cuniinued) Weighted average pretest and post^test standard scores in mathematics achievement, by grade level, for 
schools |;>art]Clpating in early <;hildhood education, t974-75. 



The datu in Table 20 appear lo refute Ihe 
argument raised by crilies of the dala presenlcd in 
the I *)7v^-74 evaluation report that the first group 
of .schools in ECE were such a select, highly 
motiyaled tj:roup that the *'Hawtliorne effccl*' was 
responsible for their gains in tlit^fir^l year^ and^ 
thus, schools' scores in subsequeni years would 
llierefore sliow lower aebieveinenl gains, 

ESEA Titl« I 

Reading. A eomf^arison between pretest and 
post-tesi standard .scores in reading indicated a 



typical increase in relative achievenieni at virtually 
all grade levels. The flndings for progrunif! aug^ 
mented by ESEA Tille I and ESEA Title I in 
combination wilh EDY and M}ller*Unruh resources 
are presented in Figure 9. As an average, kinder- 
garten through grade eight increased in reading by 
2,3 slandard score poinis on Ihe poshlest com- 
pared lo the pretest. Grades nine through twelve 
were not included in slandard score comparisons 
because of irrcgutarilies in lesting and reporting 
procedure. They are included in grade ei^uivalent 
comparisons. 
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As cjn be seen in VMti 2 1 . grade equivalent gain 
seoa's by ^-railc levels showed that tor ESEA Title 1 
aeross all grade levels, there was a typical gain or 
M months it) measured reading ability for each 
month of reading instruction. Grade twelve scores 
are not i'lven, for the number was too small to 
enable analysis;. 

Language development Grade equivalent gain 
score information was compared for several multi- 
funded programs in grades one througli twelve. 
With 7.5 nionths of ^'lapsed time between pretest- 
ing and post^testingi there was an average of 1.3 
months' growth for each month of instruction in 
meaj;urod language j;kill across all ,programs and 
grade levels. A summary of the average month's 
gain per monlli of instruction by funding source 
and grade levd is shown in Table 22. Again, grade 
twelve scores were too small to enable analysis, A 
limiting of average pretest and post-test grade equiva- 
lent scores i:i presented in Appendix A-9, 



Mathematics. Standard score results in ntothc- 
niatics revealed that, as an average^ all grade levels 
receiving ESEA Title 1 fXmding succeeded in 
moving-closer to the national norm. In prpgram^; 
served by the combined resources of ESEA Title 
1/KDY/Miller-Unruh, a gain of 3.6 standard score 
points in mathematics achievement was seen. Com- 
parisons of pretest and post-test standard scores by 
funding source and grade levels are shown ia Figure 
10. 

Comparisons of grade equivalent scores showed 
that, with an elapsed time of 8.0 months between 
pretesting and post-testing. ESEA Title I gradeii 
one through eleven averaged K2 months* gain in 
mathematics- for each month of instruction in the 
program as can be seen in Table 23. No grade 
twelve scores are given, for the number was too 
small to Enable the making of a generaliliation 
regarding student gains* 



TABLh I** 

Average Months of Gtin in Mithemtics Gndc E4|utvalent Scores for Each Month 
of MaOiematles Instruction for Etriy Childhood Educition Schools, 1974*75 



Number of schools' and average months of gain 
for each month of instruction* by grade level 





Grade one 


Grade two 


Grade 


three. 


Funding source 


Schools 


Gain 


Schools 


Gain 


Schools 


Gain 


ECE only 


74 


1.5 


139 


1.3 


136 


1.5 


ECE/ESEA Title I 


75 


1.5 


131 


1.3 


133 


1.4 


ECE/EDY 


5 


1.3 : 


12 


1,1 


14 


1.3 


ECE/ESEA Title I/EDY 


58 


1.4 


107 


1.3 


106 


1.3 


ECE/Mlller-Unruh* 


13 


1.4 


32 


1.1 


32 

1 


1.5 


ECE/ESEA Title I/Mlller-Unruh* 


21 


1.4 


38 


1.1 


31 


1.3 


ECE/EDY/Mlller-Unruh* 


1 


1.1 


2 


.9 


3 


.6 


ECE/ESEA Title I/EDY/ 
Mlllet-Unruh* 


13 


1.5 


26 


1.1 


22 


1.4 


All ECE combined 


260 


1.5 


487 


1.3 

- 


477 


1.4 



*NOTE: Mlller-Unruh funding was present in these schools, and such funding was used 
only for reading. 
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tduvaiittiutty tiUadvantaged Youthl 

Reading. Stundiinl score giiins in rending ncliicvc- 
wum injicntcj tlmt nil grmlc levels In'crcnsed In 
relative position to the nntronnl nvcngc for tlicir 
^iiilc level. A comparison of pretest niij post-test 
scores tor progrnnis served by the eomblned 
rC3K>urtes of UDY nnd Miller-Unmli revealed nn 
nvi^nge t^nin ol' 2.7 stnndnrd score points during the 
school yenr. Tlic findings by grade level nnd 
funding sources nrc shown in Figure 11. Crudes 
innc through twelve were not included in stnndnrd 
seorc compnrisons because of irregularities in test* 
ing and reporting procedures. 

All analysis of grade equivalent scores for grades 
one through eight participating in reading programs 
augmented with funds provided by BDY and BDY 
in combination with Millcr-Unruh indicated that^ 
as an average, all grade levels attained one months 
growth -in reading achievement for each month of 
instruction. A summary of gain scores by grade 
level is presented in Table 24. Grades nine through 
twelve were not included in the grade equivalent 
comparisons because of irregularities in testing and 
reporting procedures. 



Langxutge development. Grade equivalent gain 
scores were computed for language development. 
Results indicated that grades one through eight 
averaged ^.2 months* gain in measured language 
skill for each month of participation in the 
program. A summary of the gain scores by grade 
level is shown in Table 25. 

Mathematics. Pretest and posMcst standard 
score comparisons in mathematics reveal^dthat^ as ^ 
an average^ schcols that participated in HD^ and 
BDY in combination with Miller^Unruh resoUn:es 
demonstrated positive student gains. Findings indi* 
cated that all grade levels closed the distance^v 
between their pretest achievement scores and the 
national average by increasing 2.3 standard score 
points during the school year. Average pretest and 
post-test scores by grade level for reporting schools 
are shown in Figua' 1 2. Grades ten through twelve 
had such smalt nutnbers that analysis of the data 
was not possible. 

Analysis of gnide equivalent test data revealed 
that grades one through eight programs served 
through BDY/Miller*UiTruli resouaxs averaged 1.0 
month's gain in measured mathematics sl^ilf for 



\ tabu: 2t» 



Avet^e Incmse in Gndc EqiUvalent Scoces in Retding ind Mathetnitics 

Between Pretest and Post^test for ECE Schools^ 1973*74 ind 1974-75 
in lyttirjFiist Year of Opefttion 



Item LesCed 
and iKtaAe 


1973-74 gains 
for schools 

encerins F.CE 
In 1975-74* 
(N - 814) 


1974-75 (tains 
for schools 

entering ECE 
In 1974-751 
(N - 491) 


Le%cl of 
.significance 


ReadinfT 








Cr^de one 


,75 


.98 


,001 


two 


.fi3 


.95 


.001 


chree 


.83 


1.04 


.001 










(^TAdc one 


.84 


1.07 


.001 


two 


.91 


.94 


N/S 


chree 


.99 


1.08 


.016 



*Schoolft encering PfE In t973*74 chac reporced usable grade equivalent scores 
in reading and maCheiD.tClca for their 1973*7A program* 

tSchools entering ECE ln'l974*75» »choo]» moving from partial to full funding 
In 1974*75^ or schools from those few schools in districts that received no 
exf^anslon funding for 1974*75 and that reported usable grade equivalent 
scores in hoth reading and mathematics for their 1974*75 program* 
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Fig. 9. Weighted average pretest ind posMest standird scores in reiding ichievtment 
in ESEA Title I funded programs, 197^75 
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Title l/MillerUnruh* 
by grade level, for schools pariicipaling 
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Fig. 9. (continued) Weighted average prtiest and posi-iest siandard scortsJn reading achievement, by grade levef. Tor schoots 
puriicipaiing in ESEA Tiile \ Tunded programs, 1974-75 ^ ^ 



ciicli inontli of piirticipation in the program. A 
sunimiiry of guiii scores by funding sources and 
gnitic levels is displayed in Tuble Grades nine 
ilirongh twelve were not included in the compari- 
sons because of small numbers and irregularities in 
testing anti reporting procedures. 

Bilingtiat/Cross^rtiEiural und MuEticutluiat Education ' 

The two instructional areas of bi lingua l/cross- 
eiiltunil ami inultiailtural e(hication are served 
throuiili all landing sources and, coiise(|Ucii'iy, are 
reported in this separate section of the report, 

tiitmgual/cross'cuttural education. All school*; 
with limiteil and/or non-bnglish speaking students 
ivcrc rc(iuireO to dt*velop programs to meet those 
students* needs. l::ich school which had an enroll- 
ment ot whicli 1.5 percent or more were limited 



and/or non-English speaking students and which 
received supplemental funding during the 1974-75 
school year was required to develop and submit 
a bilingual/cross-cultural component for those 
students. 

A bilin^uaI/cross-<;ulturJ) approach to instruc- 
tion can include various combinations of English, 
native language, English as a second language, and 
native language as a second language in the 
instructional areas of reading, mathematics^ Ian- 
guagCr and multicultural education. 

A total of 42,274 students whh a primary 
language other than Englisli participated in the 
bilingual/cross-culturai components of schools re- 
ceiving additional federal or state funding. Of these 
studentf., 24,340 spoke English with limited flu- 
ency,, I0i051 were non-English speakers, and 7,H83 

^(Tcxi cotumucd tm pan*' ^S) 
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Average Months of Gain Reading Grade Equivalent Scorts for Each Month ^( Reading 
IftstlKctron.by Grad^LcveKfor ESEA'Trtle J Funded Programs. 1974-75 

' * n _ 



Average months of gain for each month of instruction 
(and number of schools), by grade level 



Funding source 


1 


2 


3 


4 


'5 


6 


7 


.8 


9 


10 


11 


Titie I only 


1.3 
(60) 


1.1 
(185) 


i.i 

(200) 


1.2 
(317) 


1.1 

(297) 


1.1 
(273) 


1.1 
(24) 


1.1 
(21) 


1.5 
(48) 


1.3 
(35) 


1.2 
(20) 


iltie J-/ ^1^1 

Title 1/ 

Miller-Unruh* 

Title 1/EDY/ 
Miller-Unruh* 


(44) 

1.2 
(37) 

1.2- 
(22) 


(221) 

1.0 
(93) 

.7 
(84) 


(231) 

1.0 
(83) 

.9 
(79) 


(267) 


(422) 


± . z 
(387) 


1 C\ 
± k u 

(31) 


1 n 
(31) 


1 6 
(34) 


(19) 


1 7 
(12) 


Weighted average 
(Total number of 
programs) 


1.2 
(163) 


.9 
(583) 


.9 
(593) 


1.1 

(584) 


1.0 
(719) 


1.2 
(660) 


1.0 
(55) 


1.0 
(52) 


1.6 
(82) 


1.3 
(54) 


1.5 
(32) 



*NOTE; Miller-Unruh funding was present in these schools, and such funding was used 
only for readings 
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Average Months of Cain in Language Grade Equivalent Sc<ires for Each Month of Language 
Instruclion. by Grade LevelJor iiSEA Title I Funded Programs, 1974-75 



Average months of gain for each month of instruction^ 
(and number of schools), by grade level 



Funding source 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


Title I only 


1.3 
(26) 


1.3 
(49) 


.9 
(60) 


1.3 
(148) 


1.5 
(130) 


1.5 
(116) 


.9 

(8) 


.9 
(7) 


1.6 
(28) 


1.9 
(15) 


1.2 
(10) 


Title I/EDY 

Title 1/ 
Miller-lf^ruh* 

Title I/EDY/ 
Miller-Unruh* 


1.3 
(25) 

1.6 

(22) 

.1.2 
(11) 


1.7 
(39) 

1.9 
(38) 

1.6 
(20) 


1.3 
(50) 

1.3 
(34) 

1.1 
(21) 


1,2 
(123) 


1.3 
(140) 


1.1 
(121) 


.9 
(13) 


1.6 
(11) 


1.7 
(10) 


1.5 
(7) 


.5 
(7) 


Weighted average 
(Total number -of 
programs) 


1.3 
(84) 


1.6 
(146) 


1.2 
(165) 


1.2 
(271) 


1.4 
(270) 


1.2 
(237) 


.9 
(21) 


1.4 
(18) 


1.6 
(38) 


1.7 
(22) 


.9 
(17) 

_ 



1 fi 

*NOTE: Miller-Unruh funding was present in these schools, and such funding was useJ 

only for readings 
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Fig. 10. Weighted average ^rttesn and post-te&t standard scores in mathematics achievement, by grade level, for schools partici- 
O pating in ESEA Title I funded programs, 1974^75 

ERJC 57 



52 



90-| 

SO- 
TO 
60 



1 50 
? 40- 
30- 
30. 
10- 
0- 



National average 



'4 



"1 

80-| 
704 



!: 60-1 
■2 50H 



^ 40- 
30- 
20 
10 J 
0 



National average 



1 

i 
I 

77 



^Pretest 
□ Post-tost 



5 ^ 



%1 ^ 



n 

I 

6 



0^ 

t 

O 



00 

[ 



Title l/MillerUnmh'' 



Itt o 



00 

o 



00 

t 

2 



Title 1/ 

Educationally Oisadyantaged Youth/ 
Miller-Unmh* 



90 n 
80 H 
70^ 

60 4 

? 40 
30 
20 
10 
0 



r 



il 



-2 0 

5t ;t 



^ 3 



National average 



If' 



r 1 

I 

c 
O 



O 



i 



s 



i 



i 




u 



J 

t 



t 


( 


r 


Seven- 




Nine- 




Tttte I Programs^ 



^NO n : Mitkr-Umuh liimlini^wjs present in these schools, an<l such Aindinj^^ was use<l only for r«jilin>s, 
^ \ A^ci}fhkJ stimnury of ull combinjitions of funJing sources shown iibovo. 



Fig, to, (continued) We^^tcd 9verage pretest and posMest standard scores in mathemaUcs achievement, by grade level, for 
schools participating in ESEA Title I funded progrums, 1974-75 




wcri.- tlnoiU III Iji^ilisli' Students with Sp;iiiisli us 
Ihoir tirsi liiii*|nuiiJc wcro Mio hirgcsl group in Ihu 
hiUii^MUl/cross-cnltiinil conipoiioiit. accounting for 
.^X,S^3 of the purticjpniits (sco appendixes A-3 mul 

Progriiin (ibjectivos for nil students were sinnlnr 
(see nppeiidi\es B-12 through B-17), Objectives Tor ' 
reading and language development e(nild he ciassi- 
Tied into iiiereased skills in these aa\is: more 
positive teulingSi purchasing, or developing mate- 
riiils with which to gain skills, and management of 
the program: wlierciis mathematics objectives re- 
lated to instnictioiL meastircmeiit of student 
growth, and iiiaiiageiiieiit ol' the program. 

Schools reported that HI percent of the objec- 
tives lor reading, 81 percent Tor language develop- 
ment, and 80 percent Tor mathematics were 
"eweeded" or '"achieved/* 

Mie kinds of program ;ictivities reportedly pro- 
vided tor students were similar. One major tiiffcr- 
eiice was that more native language activities were 
provided with greater frequency lor limited and 
iioihtjiE^^lish speaking students tbaii for students 
who were classified as llueiit in fiiighsh. These 
tnidings were observetl in all instructional areas, as 
shown by data in appendixes B-IJJ through B-23. 



Schools reported that 86 percent of their planned 
activities were implemented in reading, and W 
percent were implemented iiMnatlieiiiatics. 

An analysis of standard score reading achieve- 
ment data shows that reading performiince of 
limited-Hnglish speaking students is clo.'^ing the gap 
toward the national average at all grade levels 
except nnii. Students in grade five maintained an 
average growth rate (see Appendix A-7), Standard 
score data for reading achievement tests of fluent 
tinglish speaking students in the bilingttal/cro.ss- 
eultural component show that mean post-test 
scores for grades one through three are approach- 
ing the national average. Studefits in grades one 
througli three showed greater gains than diti 
students in grades four through six, although gains 
in reading for grades four through six also showed 
positive movement toward the national average 
(see" Appendix A-7), Mean standard .seores for 
grades seven through nine indicate gains in reading 
between the pretest and post-test period. The small 
number of participants in these grades warrants 
cautious interpretation of these results, however. 

The achievement test data for language develop- 
ment Were incomplete for students in the bilingual/ 
eross-cultural component. No raw scores were 



TABLK 23 

Average Months of Gain in Mathematics Grade Equivalent Scores for Each Month 
of Mathematics Instruction forESEA Titte I Funded Programs, 1974-75 



Average months of gain for each month of Instruction 
(and number of schools) > by grade level 



Funding source 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


Title I only 


1.5 

(63) 


1.3 
(178) 


1.3 
(188) 


1.3 
(298) 


1.1 
(283) 


1^1 

(258) 


1.0 
(21) 


1.4 
(16) 


1.6 
(42) 


1.3 
(25) 


1.6 
(14) 


Title I/EDY 

Title 1/ 

Miller-Unruh* 

Title I/E0Y/ 
Miller-Unruh* 


1.5 
(43) 

1.4 
(35) 

1.4 

(26) 


1.3 
(152) 

1.1 
(84) 

1.1 
(51) 


1.4 
(157) 

1.1 

(77) 

1.3 
(51) 


1.3 
(272) 


1^1 

(419) 


1.3 
(384) 


1.0 
(30) 


' 1.1 
(30) 


1.6 
(24) 


1.3 
(9) 


1.1 
(6) 


Weighted average 
(Total number of 
programs) 


1.5 

(167) 


1.2 
(465) 


1.3 
(473) 


1.3 
(570) 


1.1 
(702) 


1.3 
(642) 


1.0 
(51) 


1.2 
(46) 


1.6 
(66) 


1.3 
(34) 


1.4 
(20) 



*NOTE; Miller-Unruh funding was present in these schools » and such funding was used 
only for reading* 
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rcporiLM). TUc limilcd ttata reported in grade 
C(|uivalcnt gams sUow a ineasurahle language dcvcl- 
opmcnl growlli for limiled and non-English speak- 
ing as well us tlucnl English speaking slutlents- 
imlieating. as suspected, that the' educational 
growth of limited and non-English speaking 
students was less than for fluent English speaking 
students (see Appendix A- 10). 

Muthematia achievement data for limited Eng- 
lish speaking stndents show that post-test standard 

tabu; 24 

Average Months of Gain in Reading Grade Equivalent Sceies fof Each Month 
of Readily Instniction for EDY Funded Programs, 1974-75 



Average months of gain for each month of instruction 
(and number of schools), by grade level 



Ftindlng source 


1 


2 


3 


4 


5 


6 


7 


8 


EDY only 


1.0 


1.0 


* 

1.0 


.9 


.9 


1.1 


1.2 


1.2 


(9) 


(36) 


(36) 


(52) 


(53) 


(49) 


(16) 


(13) 


EDY/Miller-Unruh* 


1.0 


.9 


.9 














(6) 


(18) 


(18) 












Weighted average 


1.0 


1.0 


1.0 


.9 


.9 


1.1 


1.2 


1.2 


(Total number of programs) 


(15) 


(54) 


(54) 


(52) 


(53) 


(49) 


(16) 


(13) 



*NOTE: Miller-Unruh funding was present in these schools, and such funding was used 
only for reading* 



TABLi; 25 

Average Months of Gain in Languid Grade Equivalent Scores for Each Month 
of Language Instruction for EDY Funded Programs, 1974-75 



Average months of gain for each month of it^struction 
(and number of schools), by grade level . 



Funding source 


1 


2 


3 


4 


5 


6 


7 


8 


EDY only 


1.2 


1.6 


1.2 


1.5 


.9 


1.2 


1.1 


.8 




(4) 


(5) 


(6) 


(14) 


(16) 


(18) 


(6) 


(5) 


EDY/Miller-Unruh* 


1.3 


2.1 


1.3 














(3) 


(4) 


(4) 












Weighted average 


1.3 


1.9 


1.3 


1.5 


.9 


1.2 


1.1 


.8 


dotal number of programs) 


(1) 


(9) 


(10) 


(14) 


(16) 


(18) 


(6) 


(5) 



^NOTE: Miller-Unruh funding was present in these schools, and such funding was used 
only for reading* 



scoa's in mathematics increased over paMesI stan- 
dard scores at all grade levels (K-*^). Acliicvcnieiit 
data for tluCnt English speaking students show that 
post-test mean standard scores for grades one and 
two are equal to the mean for the normative group. 
Average standard score gains for fluent English 
students at all grades are positive and moving 
toward the national average. Moreover, post*test 
standard score means are at or above the national 
average in mathemalics achievemeni for grades one 
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Q Fig. 12. Weighted average pretesi and post-ttst stuKtard scores in mathematics achievement, by grade level, for schools partic- 
^1^1^" ipating in educationally disadvantaged youth funded programs, 1974-75 
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jiut two <scc AppoiKlix A-7), Alltiougli liinito<l 
l-jt^nlish speaking students are iiKiking gains, they 
arc pcrtbnning below tliKyii l-"nglisli s^pcaking 
students (soe ApptMidix A-7), Data for grutles 
seven, eight, ami nine slionUI he interprctt^l with 
coiisideruhic eaution. Jue to the small Stiniple si/e. ^ 

Mutticutturat K\tncatiof\, IMiring I*>74-75 tliere\ 
were 71 t;,X03 stiulents purtieipaling in nuilti- 
culUinit edueation in 2,505 setiools. Student out- 
L'onies or the nuiltieultural eoinponont could not 
U(,lei|u;ite!y doternuncd bce^iuso of the luck of 
appropriate instruiiietittttion. Coiisi.^]ucntly, the 
only statewide results whieh can be ri^portcd derive 
from the schools' sclf-rL^ports on aeliievenient of 
program objectives and eftectiveiicss of prpgniin 
aclivitics. 

"["he inulliculturdi education objectives generally 
were related to cliiinges ui performance or behavior 
01 students and were related to such end results as 
interaction of various ethnic groups, knowledge of 
ethnic grou)i contributions, niore positive atti- 
tudes, and a greater understanding and acceptance 
of other cuUua'S. L*inpliasis was placed on in- 
crc;Lsed intergroup acceptance, interaction, aware- 
ness/ or appreciation of group differences. Tlie 
aapiisition of knowledge that is, knowledge ^of 
the eontrihution of {\k different groups to society, 
ethnic taets, cultural heritage, and characteristics 

the various groups wus also stressed. 



Iniplenientution of the multicultural component 
relied pn activities outside the classroom as well as 
within it. t-or example, approximately 70 percent 
of the responses indicated tliiit minority persons in 
the community served a.s role models when they 
were employed as aidiis, teachers, or resource 
personnel. 

The activities reported to be most effective 
included experiences provided through assemblies, 
fairs, holidays and eelebratio^ns. use of nmltiethnic 
materiaU, and classroom dis^^issions. There was a 
dirb^t relation between tlje fr^^qucncy of activities 
included in objectives and tlit'ir elYcctiveness as 
rateil by program personnel. Thirty-nine percent of 
the reports indicated that their components were 
based on a skills continuum. According to program 
reports, the niost effective mat^jrials used wea* 
films and filmstrips, books, songs,! demonstrations 
and visual aides, and learning units developed in 
the classroom. 

Cocurricular or extracurricular activities dealing 
with ethnic differences were provided through 
holiday programs and celebrations and incorpo- 
rated food, musiq, art, and dance. Irftegration of 
multicultural concepts with other aspects of the 
curriculum was mentioned by many projects. Most 
actfvities were rated as "elTective" or as "very 
effective," with the ratings showing that the most 
effective activities were use of multicultural mate- 
rials, group discussions, and cultural programs. 
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Average Months of Gatn^in Mathematks Grade Equivalent Scores 
for Each Month of Mathematics Instruction 
for EDY Funded Programs, 1974-75 



Average months of gain for each month of Instruction 
(and number ot schools), by grade level 



Funding source 


1 


2 


3 


A 


5 


6 


7 


8 


EDY only 


i.i 


1.1 


.9 


1.0 


1.0 


1.0 


1.3 


1.0 




(10) 


(35) 


(36) 


(53) 


(51) 


(A9) 


(lA) 


(11) 


EDY/Miller-Unruh* 


1.3 


la 


1.0 














(6) 


(17) 


(15) 






\ 






Weighted average 


1.2 


1.1 


.9 


1.0 


1.0 


1.0 


1.3 


1.0 




(16) 


(52) 


(51) 


(53) 


(51) 


(A9) 


(lA) 


(11) 



*NOTE; Miller-Unruh funding was present in these schools, and such funding was used 
only for reading. 
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V. ESEA Title ! Programs for Handicapped Students 
and Neglected and Delinquent Youths 



During 1974-75, bSEA Tillo I grants lo slale 
agencies served almost 76,000 students qualifying 
for compensatory education program^*. These pro- 
grams ineliided 6K049 ehiUlrcn of migrant 
wofkers, 4,681 handieapped eMIdren in special 
schools operated by the Department of Kducation 
and in state hospitals operated by the Department 
of Healths 8,363 -neglected and delinquent youth in 
institutions^ 1,726 'delinquents in institutions 
operated by the California Youth Authority, and a 
small number ot' felons in institutions operated by 
the Califomiu Department of Corrections. (A 
separate evaluation report on migrant education 
will include information regarding services to these 
students.) 

Program.s for Handicapped Students 

SpectaJ Schools Programs 

Six special state schools administered by the 
iX^partment of Kducation received ESEA Title I 
funds during 1974-75 to attgment instructional 
programs for the blind, deaf, and neurologically 



handicapped. A total of M 18^ handicapped stu- 
dents in special schools participated in augmented 
instructional progiums funded by Title 1. Of that 
Jiumber, 1 12, or 10 percent; were blind; 906> or 81 
percent, were deaf; and 100, or 9 percent, were 
neurologically. handicapped. Tlie number of stu- 
dent participants by &ge range are shown in Table 
27. Programs were in x)peration between 184 and 
206 school days. Participants in the schools for 
neurologically handicapped students attended 
classes between three and nine months. Students in 
schools tor the deaf and the blind attended classes 
for the full academic school year. 

Programs at the several schools served students 
when local educational agencies were unable to 
meet their specific educational needs. Services 
included comprehensive diagnostic evaluations and 
counseling services for parents and families of 
handicapped students. The schools also partici- 
pated in cooperative training programs with the 
University of California and California State Uni- 
versity and Colleges systems in professional intern- 
ships and teacher training. 



TABU: 27 

Number of Handicapped Students Participating in ESEA Title I 
Programs in Speciil Schools, 197475 





Number 


of students participn ting. 


Qra^ie level 


School for 
the Blind 


Schools for 
the Deaf 


Schools for the 
Neurologically 
Handicapped 


Kindergarten through grade six 


42 


207 




.Junior high 


32 


172 




KenioT higii 


3 


421 




Vnf^raded 


35 


106 


100 


Total 


112 


906 


100 
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l^umJijiij: pmvidcil by bSbA Title I cnabkil the 
several s[Vcial m:IiooIs lo suppknienl Ihcir inslruc* 
tionul programs in rcailitig. langiia^iic. and matlie- 
m;itics for the idcntined target students. StatT 
Iraiinng, uti\iliury services, and parent participaUoii 
.ictivities were adjusted to meet the students' 
unique needs and circunistanct'S. Program cffec- 
Uveiiess wa^ determined through commereially 
:ivailjble staiiilardi/.cd tests, loeally developed 
criterion^a^rereneed measures, and observational 
techniques. 

Progmms Administered by the Catifomia 
[VpartnKnt of Health 

f Title I appropriations to the California 
IVpartnient of Health provided tor the estahlisli- 
luent of supplementary educational components in 
statv' and local health treatment programs. A total 
of 3.5()3 handicapped students participated in 
these activities. Of the student participants 2,236 
or fO.S pereent were developinentally disabled, 
thos** whobe special needs resulted troni such 
f u nctional inipairjuents as emotional stress, 
psychosis, or drug abuse; and 1,327 or 37.2 
t>ercent were mentally disabled. Compounding , 
these funetiotial limitations for many students 
were secondary haiulieaps aftectiug vision, hearing, 
anibulatioiK and metabolism. Skills required for 
normal funetioning ranged from a developmental 
age of one year to late adoles^-'eiicc. Aeademically. 
because of the severe nature of their emotional 
disorders, the students' learning difliculties cen- 
UiK\\ arouiul reading and listening, understanding 
words and synibols^and writing imd speaking. 

The IVpartnient of Henltirs programs were 
openited in I ^1 state mental hospitals and 1 7 
LDinmunity mental health faeilities geographieally 
Jistrihuted throughout the slate. They operated 
Ix^tween 200 imd 3(^5 days, with an average period 
ot^ attendance of nine to 12 months for the 
developinentally disatiVL ^lutl five to eight months 
for the mentally disablecL 

The State DepartUK^nV Kducation officials 
provided support in the Form of general super* 
visioJK coordination, monitoi^ng. and eonsulting 
services, while loeal eoordinalof^i provided program 
development, implementation, and evaluation ser- 
vices. 

goal of the programs was to raise the 
partlcipaius to a level of independenee. All ESUA 
Title I programs administered by the Department 
of Health emphasi/ed language development as the 
primary component, with activities in stalT devel- 
opment and intergroup relations as* support compo* 

<ir> 
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iients; in a lew faeilities, participant abilities 
pennitted the use of mathematics as a component. 
Program effectiveness" was measured using cither 
r;ite of change per unit time in atteiidanee or 
criterion standards tor precstablislied objectives. 
Signifieatit improvement was made in all eoin* 
ponents. The California Department of Health 
publieation, Leartu Compensatory ^ Educatiott 
Report 1974'7X contains greater detail of these 
programs and their'results. 

Other Progrsms for Handicapped Students 

Two additional programs, that at the Neuro- 
psyehiatrie Ihstitute at the University of California, 
Los Angeles,! and that at Clearwater Ranch, Mendo- 
cino County, also received monies from 1:SKA 
Title I hanuicapped funding. Both of these pro 
grams were initiated in 1074-75 and served a small 
number of students with severe handieaps. 

Programs for Neglected and Delinquent Youth 

ESEA Title 1 program: served identified ne- 
glected and/or delinquent students in a variety of 
special institutions. The programs included those 
administered by the California Youth Authority, 
the Departnient of Corrections, and local educa* 
tional agencies. While complying with conditions 
necessarily imposed by the institutions, each of the 
agencies was required to develop a comprehensive 
educational plan for its use of ESEA Title I funds; 
this plan included both instructional and instrue- 
tionai'Support services for the students served. 

Local Edtictttoruil Ag^cy Programs 

In the 1974-75 school year. 8,363 liSliA Title I 
students were served in 154 programs for the 
neglected anil delinquent administered at the local 
district or county levels. The nuniber and pereent 
of students by grade span and type of institution is 
presented in the appendix, Kindings indicated that 
proportionally more of the neglected student 
population in public and nonpublic school pro- 
grams were served in (preschool through grade nine, 
while the majority of delinquent youth were 
reported in grades ten, eleven, and twelve and in 
ungraded high school programs. 

The average length of enrollment for neglected 
and delinquent students varied from less than one 
month to more than 19 months in both public and 
private agencies, with an average duration of 7J 
jnonths for^ the negieeted and 5.2 nionths for 
delinquent students. 

The primary objectives of most programs for 
neglected and delinquent youth were to raisc^ 
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academic ;icliicvcnKiit und to promote titUtudinul 
ctiangcs toward themselves, their peers, and the 
larger swiety. The most fre(|uently stated objec- 
tives iiichided improving hasic study skills, pro- 
viding successtul experiences, developing a more 
positive attitude, and reducing the recurrence and 
severity of diseiptinarj^ probleins. To achieve pro- 
gram objectives, staffs in the mojority of institii* 
tioiis concentrated on counseling and on a 
di;igiiostic. prescriptive instructional approach re- 
lated to mdividual student needs. 

Shice tlie attainment of objectives was depen- 
<lciit on informed program persoiiiicL most faeili^ 
tivs developed aetivt^ inservice .training for tlieir 
protcssional and t)araprolcxsipiial staff. Tlicsc 
activities were designed to eoinpleiueiit the intent 
of the programs by eniplia:»i/.ing instructional 
diagnostic and prescriptive methods, use of new 
tcchni<|ues and materials, problems of neglected 
and delinctueiit youth, ond ways of providing a 
more effective transition for the student returning 
to regular sv'hooL Tlieso areas were addressed in 
workshops, orientation sessions, visits to other 
i>r<^grains, eonference attendance demonstrations, 
and work with support service persouiie!. Regularly 
scheduled nicctings for on-site staff were reported 
by a majority of the progranis. 

Programs generally reported improved student 
perloriiiaiice in iiistnictioiial areas, although the 
interval between pretesting and post-^testing was 
lre<|neiitly too short, and the numbers of students 
.It particular gra<le levcis were loo small to allow 
jov but the mo>it tentative eonehisions. Student 
icsults other than aeademie gains were reported by 
tiiaiiy programs and iiieluded increased ability to 
cominunieate with staff tiiid peers, increased over- 
all motivatioUi aiul applieation of basie skills to 
areas other than rea<lingand math. Also mentioned 
.were reduce<l referrals to the courts and less need 
ft^r aUmmistraJive discipline. For older students, 
more iiilerest in vocational options was cited as a 
rcsufl of career progmms 

Progranis Administered by the California Youtti 
Authority and the California Department 
of Corrections 

I SI'A Title I lumis are allocated each year for 
<|ualifying students committed to the California 
^'ontl^ Authority (C YA) from both juvenile and 
criminal courts and lor those committed to the 
Department of Corrections from criminal eourls. 
As an average, students are between sixteen and 
twenty years of age and have shown behavior 
wliicti frequently includes a history of poor school 
experieiice. The rea<ling levels of iipproximately 70 



percent of the students in the CYA institutions are 
three or more years below their age-grade level; 
more than fiS percent are three or more years 
retarded in mathematics skills. Further, approxi- 
mately 28 percent of the CYA participants have 
come to be regarded as high school dropouts. 

The challenge for ESEA Title 1 programs admin* 
istered by the California Youth Authority has been 
to nu^tiyate students, to raist^ their aeadeniie 
achievement levels, and to guide tliem^lnto pro- 
ductive and responsible pursuits. 

During 1974-75, ESEA Title I programs served 
L726 students in 12 institutions operated by the 
California Youth Authority and students in three 
institutions operated by the California Department 
of Corrections. 

The emphasis in ESEA Title 1 programs in CYA 
institutions was qpon instruction in reading, 
langiia^, and mathematics^ using diagnostic/ 
prescriptive methods. Instructional methods in- 
cluded small group instruction, use of commer- 
cially developed media materials, and individual 
tutoring. Four schools used the individualized 
manpower training system approach to academic 
skill development* Other institutions implemented 
locally developed systems designed to meet the 
needs of the students and the requirements of their 
respective facilities. Use of teaching assistants 
and/or student ;^ides was reported as an integral 
part of each ESEA Title f program. 

Although the academic perforniancc of students 
by CYA institution varied ^widely, it was found 
that students typically Achieved more than one 
month's gain in readings language, and mathematics 
for each month of participation in the prograiii. 
Student gains in reading ranged from .8 to 2.5 
months per month of instruction: from l,^ to 4.3 
months' gain in language development: and from .8 
to 3.S months' gain in mathematics. 
^ Schools reported that students in CYA institu- 
tions demonstrated reduced frustration and better 
attitudes toward school as a result of niore 
systematized diagnostic-prescriptive instruction* 
^^Sehools which placed heavy emphasis on pro- 
gramiiied^ learning reported that students showed 
an increase in autonomous learning, better work 
habits, and better ebssroom conduct. Most of the 
schools developed diverse progranis to meet the 
^ needs of students at different remediai levels. 

Several CYA progranis reported that there was 
more active participation on the part of the total 
bSEA Title I staff in planning the total program. 
Tliis led to better eoopenitioii among staff and 
better services to students. 
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V!. Summary of Findings and Their Implications 



Tlic tlmlings prcscnlc^l in lliis scclion of Ihc 
reporl were IxiScU on a review uiul aiialybis of Ihe 
Uab tjtatUea'U by tlie State Department of HUuca- 
lioii a'gardin^i those sehooi*; partieipating in the 
early ehiiUhood education (hCE) rctorm effort and 
those witli hSUA Title I and educationally dis^d- 
viiiitaijed youth *UDY> proijrains in 1974-75* The 
evaluation tmdintjts are arranged according to this 
order: institutional change: b^udent achievement; 
l^rticipanls in KCK, KSUA Title I, and fiDY; 
expenditua patterns; and the evaluation proees:*. 

Institutional Changes 

l-Aidence of institutional change in schools 
witliin the hVM reform effort was gathercil trom 
th.e ^luality rating;; of tlie school level plans, quality 
reviews coiidtictod during the iuon***rand review 
(NtAR> school Visitations, and the product evalua- 
tion reports prepared by schools hi which they 
descriK'd and evaluiited their programs at the end 
*>rthe yean The changes in the schools (institutional 
chunsiC) were evident trom these 1^)74-75 findings: 

^ The plan rating intbrmation showed that all 
the schools were doing systematic planning, 

- with more than 75 percent conducting quality 
needs assessments. 

• The plan rating information showed that 80 
IKTcent of the schools werc able to write 
quality goals, and 70 iKTccnt were able to 
develop quality objectives. 

• The product evaluation report information 
showed a 54 percent increase in number of 
participants in parent participation compo- 
nent activities and a 55 percent increase in the 
number of participants in parent education 
component activities over the 1973-74 data, 
with a 30 percent increase in participating 
schools. 

• The monitor and review (MAR) data showed 
that of the 913 ECE schools visited, more 
than 87 percent had individualized, diagnostic 
instmctional programs operating at or above 
the satisfactory level in all phases of reading 
and mathematics* 

• The MAR data showed that more than 85 
percent of the schools had staff development 



programs which systematically were meeting ' 
the assessed needs of teachers, paid aides, and 
administrators at or above the satisfiictory 
level. 

• The self-report data in the product evaluation 
report and in-depth study information indi- 
cated that local evaluation was occurring* 

The elear implication from these findings was 
that ECE schools were making m^jor changes 
throughout many areas of their programs, indicat- 
ing in turn basic changes in the institutions. 

Three areas of institutional change, although 
rated welh were sufficiently below a level of 
quality to warrant further cxaminatlon: 

1, More than 25 percent of the ^^13 ECE schools 
visited had some language; devlopment areas 
related to individualized instruction which 
werc below the satisfactory levcK Additional 
data indicated a lack of clarity existed regard- 
ing the meaning of language development* and 
the data also indicated that instructional mate- 
rials and measurcment tools were lacking. 

2, Twenty-three percent of the 913 ECE schools 
visited were rated )>clow the satisfactory level 
in parent partieirfktion in program evaluation* 
Tliis indicated a need for more effort to 
involve parents itUhis specific activity. 

3, The inservicc programs In 27 percent of the 
ECE schools visited were rated below the 
satisfactory level in meeting the assessed 
needs of volunteers- This finding indicated a 
need for increased attention lo this area, 
particularly since the number of volunteers in 
schools has increased so greatly. 

Student Achievements 

In student reading and mathematics ;>nhieve- 
inent, the results of programs developed with all 
funding combinations equaled or exceeded last 
year's achievement, which was an average gain of 1 1 
months' growth tor 10 months in schooi. In addi- 
tion, the pre-post standardized testiiig showed that: 

• ECE only schools attained reading achieve- 
ment above the national average on post-test 

^ scores in ail grades served. 

67 



ERiC 



61 



• Soliwls ill the KCK relbrni effort tended to 
liuvc liigliLT guilt scores in ull uchievement 
iireus (Uan schools not included in the effort 
tl Sl-A Title I aiid/or KDY only). 

• Schools with KSKA Tide 1 and EDY funded 
prograim niaintained month-to-month growth 
when historically such schools would only be 
expeeted to gain seven months in ten months 
of instruction. 

• Sehools entering tiCl: for the first titne in 
r>74-75 had sigmlleantly greater achieve- 
ment, statistically, than the original schools in 
1073-74 in all art'us except second grade 
nudieniatics. 

Ill jddition the CaUroruia'^state assessment test- 
m^i sliowcJ ihul sUulents in the L-CK process 
achieved Mi^^tnl'tcatilly hi^iher^ statistically, thun JiO 
matched ^ronps of stiklenls not in the ^iMgranu 

, Ptirticipams in ECB. ESE.4 Title I. and EDY 

A total (if iSO(\752 students were served through 
the conibined tl CH. i-SHA Title U tDY> funding 
sources in r> 74-75. Sixty-five percent of the 
students were enrolled in kindergarten through 
-r.kie three HX'li. l:SbA Title 1, iind EDY); 23 
|iercen(. m grades four through six (ESBA Title I 
and I l)V): and 1 2 percent, in tirades seven through 
tttcKe ilSUA Tilte 1 ;iiul tii)Y), More students 
rrccived services in readuig tlian in any other 
mstructiun^rl component. A djiplicated count 
shovted thai 770,000 participatini; students were 
mdudcd tn reaiHng inslmction, 580,000 in lan- 
gua^ie Jevelopment. anil 717,000 in niatheinaties. 
Larsic numbers of volunteers were working in the 
pn>gran*s: t*7.000 adults coutrihuted 200,000 
luuirs per \K'cck, and M,00(j students contributed 
I5(n000 hours pef week. 

Expenditdre Patterns 

1 xjiumatiou of the Inial tlscal reports froip a 
Imutcil sample of districts showed dirterenees in 
the pjttL-nis of expenditures within KCE, l:SEA 
lilte- I, ami I.DY. In i;CK. 55 percent of the funds 
went to pay classitled salaries, and ?A percent of 
the itiiids were lused for certificated salaries. In 
I-.SI:A Title I programs. 43 percent of the funds 
were used lor classified salaries and 53 pereent for 
certificated salaries. In RDY programs, 10 pereent 
of the funds went to pay c'lssificd salaries, while 
71 percent of the funds were used for certificated 
s.i|jnes. The need for an analysis of all tlie 
expenditure data was implied by this finding, and 
that jjialysis is currently being made, 
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Evaluation Proecss 

As indicated in "Procedures, liustrunientatioiK 
and Limitations," problems were identified in the 
evaluation instrunientatioii. The Department has 
already made the following changes for l^>75-7h: 

1. The plan rating histrnment lias been rede- 
sit^ned to correspond more closely to the 
planning process. Also, inter-rater reliability 
ealcilations are being made on the plan raters. 

2. In hgh(^ the eotieerns raised In l074-75» the 
monitor and review (MAR) instrument lias 
been redesigned to m;ike it more functional 
and to allow separate measurenionts of iniple- 

^ mentation aeeording to the schoars plan, 
progress toward restructuring or revltali/a- 
tton, and ijuality of the program. Mea.sure- 
ments of inter-rater reliability and addilional 
jiiserviee training In the instrument's use arc 
being pursued. 

3. Tlie instrument used to assess program conv 
pHance has been r^^nced in size, and it focuse;^ 
on statutory re(|uirements. 

4. Tlie progress implementation report has been 
eliminated, sinee was a re(]uirement which 
seemed to report data of little usefulness. 

Z. Tlie produet evaluation report has been re* 
duced in size and will specify only eininicra- 
tion data, data frot^ standardized test results, 
and data on the schoofs aecoinphslinient of 
objectives. All standardized test results are to 
be reported in mean raw scores. 

6. Innlepth studies, with less dependence on 
self-report data, will be done only for seleeled 
components and processes, emphaia/itig the 
processes of institutional change. 

7. Plans are beine made to provide longitudinal 
data in the continuing evaluation process. 

Tliere was difllculty in measuring gains of 
Uinited-English and non-English speaking students, 
due to, the lack of appropriate 'instrumentation. 
Tlie Department of Education is currently engaged 
in developing such instlrumentatioiu but it is not 
scheduled to be completed until 1077. The same 
problem of pre-post gain measurement will there- 
fore exist in ttie 1975-76 report. 

Because the consolidated evaluation format pro* 
vide<l comprehensive program information instead 
ol isolated information for each funding source, 
the continued use of this format i.'i indiealed for 
the 1975-76 cousofidated evaluation repori. This 
npproaeh, with the previously specified modifica- 
tions, should provide even fuller (lal;i for l^>75-76. 

75-141 oe ^377 2 76 320 



